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PREFACE 


The book is an elaboration of lectures given at The National 
University of Peking in the fall and winter of 1934-35. It is 
intended for students who have completed a course in Advanced 
Calculus, but have not as yet entered on the study of the Theory of 
Functions, either real or complex. Emphasis is laid on the new 
methods, and these are illustrated by many and varied applications, 
and numerous exercises. \ 

Chapter T deals with * convergence of infinite series. The 
student has hitherto been concerned chiefly with the results of 
limiting processes, the applications of the Calculus. As the next step 
he needs training in the more abstract use of simple limits as applied 
to problems of a purely analytic nature. He needs to live in this 
new domain of thought, in which the limiting process is the central 
idea. And he needs to work many simple problems, in which the 
existence of the limit is the chief end. 

Chapter II. The Number System. The student has thus far 
taken the system of real numbers for granted, and worked with 
them. He may continue to do so to the end of his life without 
detriment to his mathematical thought. Thus he may omit this 
chapter altogether, taking the Theorem of Continuity, § 5, as a 
postulate, but noting, of course, the definitions and theorems of 
§§6,8,10. On the other hand, most mathematicians are curious, 
at one time or other in their lives, to see how the system of real 
numbers can be evolved from the natural numbers. Dedekind’s answer 
is not the only one, or even the simplest one for the beginner; but 
it is one no mathematician can ignore and to which, probably, 
most mathematicians will give first place. 

With Chapter III, Point Sets, begin the new concepts which are 
fundaunental in the Theory of Functions of Real Variables, and this 
chapter may form the starting point for the beginner, so far as any 
logical difficulties go. The concept ; function^ is treated in §§ 3, 4, 
and now comes the definition of limits § 5. The proofs chosen for 
the Three Theorems on Continuous Functions may well be criticised. 

iii 
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Should not the writer pick out the method most easily accessible for 
the student (say, tlie metliod of nested intervals) and use that one 
method systematically? This is precisely what the student should 
do, usin;^ these other proofs as exercises. Let me say right here 
that tlie only way in which the student can hope to attain mastery 
of ihe subject, is to write his own book. He should take each 
theore n by itself, state it in his own language, and prove it as the 
author ought to have proved it for tliat student’s needs. The clearer 
the presentation in a text-book is, the worse for the student who 
would rely on reading. The student rumt himself produce his own 
independent proofs of the main theorems, in writing, and then come 
back again and again to his own presentation, as he walks to a 
lecture or strolls through his favorite haunts in this enchanting city. 
First, the content of the theorem ; secondly, the method of proofs 
must go over into his flesh and blood. It is a question of habits of 
thought, and habits are fonned by repetition. 

To CO ne back to the three theorems on continuity, the student 
should ultimately dominate all the methods set forth. But it is enough 
at the beginning to have one metliod of proof for each theorem, and 
the choice is left to him. l/bt it be said that no one can teach the 
student the 'riieory of Functions. For the Theory of Functions is a 
habit of thought, not a set of rules to be applied like the formulas 
of differentiation. 

In saying these things we have really forecast the whole study 
of the uniform question. The difficulty with uniform continuity 
and the uniform convergence of series and integrals lies not so much 
in the definitions, and in the statement and proof of the theorems, 
as in recognizing a double-limit question when it arises in practice. 
For these questions are not labelled: — “Here is a double-limit.” 
It is on this account that especial pains have been taken both to 
illustrate the situation geometrically by graphs, and analytically to 
formulate the situation as a 

lim [ lim s (n, m) ] == lim [ lim s (tz, m) ] 

n~co rn=oo m— oo /*— oo 

question. It is with deep regret that the writer feels forced to treat 
systematically the double-limit questions for proper integrals. The 
student, after mastermg Chapter V on Uniform Convergence of 
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Infinite Series, should find his own questions for the proper definite 
integral : 

h 

J f{x,a.)dx, 

a 

and treat them independently. He can still do this, in the main, 
by reading only casually w^hat is said in the text of Chapter IX and 
then at once setting about his own indiiddual elaboration of this 
whole subject. Even the case of improper integrals: 

oo 

J fix, cl) dx, 

c 

can be treated in like manner, and it is not till the question of the 
reversal of order of integration in the iterated improper integral 

oo C30 

J dx f f{x,y)dy 

a b 

arises, that he needs specific guidance. Here, again, however is an 
opportunity for independent thought. Let him do Chapter IX with 
a minimum amount of help from the book. 

But method is not the sole topic, nor should it appear to the 
student as an end in itself. His taste in analysis must be cultivated, 
and to this end, what better material than the elementary functions, 
developed out of their differential equations and leading to their 
expansion into series of fractions and infinite products; the F- and 
B-functions with their integrals and products, and a first suggestion 
of ELsymptotic expansions ; Fourier’s series and the develop nent problem, 
with an example of a di ^g gent series, uniformly summable; Fourier’s 
integral, with applications, and extension to junctions of several 
variables ; finally, differential equations, total and partial. 

This last subject has the widest ramifications in pure and 
applied mathematics, and courses of the nature of rule of thumb are 
everywhere current. Two things the student needs to know in 
advance, namely; the intrinsic meaning of a differential equation, and 
the existence theorems governing the solution in a restricted region. 
The proof of the latter affords opportunity for expounding, on the 
hand of this important application, the greatest single method in all 
science — the Method of Successive Approximations. 
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PREFACE 


The plan of publishing these Lectures was fii*st suggested to me 
by my old friend and pupil, and present colleague at Peita, Professor 
Kiang Tsai-Han, who has accompanied their preparation with warm 
interest and generous support. 

It is a pleasure to express my deep appreciation of the efficient 
cooperation of the University Press, The National University of Peking, 
in this difficult task of mathematical composition. My former Assistant, 
Mr. Hsii Pao-lu, was most helpful in preparing the type-written copy 
for press. My present Assistant, Mr. Sun Shu-Peng, has been of 
inestimable service to me in seeing the book through the press. His 
keen interest in securing accuracy of detail, and his excellent 
common sense, have made him a most extraordinary helper in this 
undertaking. 

Peiping 

December 17, 1935 
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FUNCTIONS OF REAL VARIABLES 
Chapter I 

Conver^^ence of Infinite Series 

§1. Definitions. L^t i/j, Wo* t>e any set of numbers 
proceeding according to a definite law. Form tbe sum: 

5/» = Mo + wi 4* * * • + 

and allow n to increase without limit. If approaches a limit, denote 
the latter by U: 

lim s„ = U. 

n=oo 

The expression 

•1) Wo + Ml -f • • • 

is called an infinite series (or, more simply, a series). It is said to 
be convergent if $„ approaches a limit, U\ and this number U is 
assigned to it as its value. U is sometimes called the sum, but this 
nomenclature is unfortunate, since it is impossible to add an infinite 
number of terms together. 

If Sji approaches no limit, the series is said to be divergent, and 
no number is assigned to it as a value.* 

A familiar example of a convergent series is the geometric pro- 
gression 

2) a + ar ar^ + • • • , 
where r is numerically less than unity. Here, 

3) + • • • + ^ — — 

1— r 

and 

lim Sn == 

1 — r 

Hence 

= w + ar + wr- H , | r | < 1. 


• To certain divergent series values are attached through other convergent pro> 
cesses, some of which will be considered later. 
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A further example is the series 


_L + J_ + _L+. 

1-2 2-3 3-4 


whose value is 1. Here, 


*» = f 1 - 

1 \ i 

r 1 

1 X 

+ r 

1 V 

/ 1 

“■ TT J + 


~ T- ) + • ' 

- — d- — 

\ 

2 / ' 

^ 2 

3 ) 

\n-l 

n J 

\ n 


Sn — 1 — 


lim = 1. 


t xxiii — X. 

n-^~\ n=x 

The early mathematicians thought that a series must converge if 

the general term approaches 0 as its limit: lim = 0. But this is 

71-=. CO 

not the case. As an example, consider the harmonic series^ 

6 ) + 

It is possible to find n terms, the sum of which will exceed any 
given number, no matter how large. For, obviously, 

— \ p — 1 — ^ f- — 1 — > -l 

m-f-1 m-b2 m-hm 2 

since these terms (except the last) exceed respectively the terms 

— 1 ^ d- • ' • + — (to m terras), 

m + m wd-m m + rn 


and the value of this sum is So we see that, striking in any- 
where in the series, we can add a definite number of terms which 
will yield a sum greater than i, and hence Sn increases without limit 
as n increases. Thus the harmonic series diverges. 

Tiikori;m. a necessary condition for the convergence of an 
infinite series is, that the general term approach 0 as its limit. 

To deny the truth of the theorem is to assert that there exists a 
positive constant, h, such that, no matter how large m be chosen, 
there will always be a term, Up, for which 

\up\> h, p> m. 


But here is a contradiction. Mark off an interval about the point 


U, extending from f/— € to 17 d- €. Since 
Sn approaches (7 as ift limit, the points Sn 
will aU remain within this interval when n 
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is greater than a suitably chosen integer, ^ : 

< (7 + €, ^ ^ n. 

Here, € may be any positive quantity. Choose € = i /t. Tliere 
will be a term Up such that 

1 M, 1 > A, P> 

Now, Sp^i lies in the interval {U — €, U + c). But, since 

Sp = Sp-i + Up , 

Sp lies outside the interval. Fro.n this contradiction follows the truth 
of the theorem. 

Exkrcisks 

1. If the series 1) converges, show that the series 

7) Um -f Um+l + * • • 
converges, where m is any fixed integer. 

2. If the series 7) converges, show that the series 1) converges. 

3. If the series 1) converges, show that the series 

8) A “h ^ d" * * * » 

where k is any fixed number, converges. 

4. Is the converse of the theorem of Question 3 true? Prove 
your answer to be correct. 

§2. Comparison Tests for Series of Positive Terms. 

Series whose terms are all positive or 0 can be tested for convergence 
by the following theorejn. 

Direct Comparison Test for Convergence Let 

zzo + + ’ • • , 0 ^ ii„, 

be a series of positive (or zero) terms to he tested for convergence. Let 

flo + + • • • , 0 g 

be a series known to converge., and let 

Un ^ an, mg n. 

Then the given series converges. 

Consider the sums; 

= Wo + Ml + • • • + Un^u 

*5/1 = Wq + tfi -f • * • 4“ W/i-i. 
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If m = 0, we have: 

Let A be the value of the a-series. Then 

S A. 

Hence 

^ A. 

Thus we have in Sn a variable which always increases (or remains 
constant) as n increases, but which never exceeds a fixed number, A. 
Such a variable always approaches a limit, C7, which in general is 
less than A, but may, in particular, = A. 

The truth of this statement is plausible if we think of as rep- 
resented by a point on a line — the scale of numbers. For, these points 
move to the right — if they move at all — as U A 

n increases. But they never pass beyond ■■■■ .i ■■■ ■■ i ■ — — < - 

the point A. They must, therefore, con- 

dense on some point, U, to the left of A, or possibly on A itself. 

An arithmetic proof of this basal principle will be given later. 
At present, we accept it as granted, and fonnulate it as a 

Fun ) A MENTAL Prtnctple. If Sn is a variable which always 
increases or remains the same as n increasesy but never exceeds 
some fixed number y A: 

1 ) Sjx ^ > 

ii) = Ay 

then Sn approaches a limity U: 


lim Sn = U, 

n~ o 

Moj'eovery U ^ A. 

To complete the proof of the Test for Convergence it remains 
to remove the restriction that m = 0. For an unrestricted m, observe 
that 

+ * ’ * + + Wm + Wm+1 + * * * + , m < Tl, 

The variable 

Um -F ^m+i -F • • * -F Mm-A+I 

approaches a limit when k increases indefinitely, as has already been 
proved. But Sn differs from this variable merely by an additive con- 
stant. Hence Sn approaches a limit, and the propf is complete. 
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We have made use of the fact that if each of two variables 
approaches a limit, their sum approaches a limit. The truth of this 
theorem is obvious geometrically. An arithmetic proof will be given 
latter. 

Example. Consider the series 


1 1 

Compare its terms, beginning with the third, with those of the con* 
vergent geometric series, 

1 1 

Since 

-h 1) > 2-2-*--2 (to n factors), 

it follows that 


1 

{n -f- 1)! 2'^ 

and hence the given series converges, 

Dirfxt Comparison Test for Divergence. Let 
^0 “h + • * • , 0 ~ m ^ tiy 

be a divergent series^ and let 

an = Un^ m ^ 72. 

Then the series 

lio + Ml H 

diverges. 

The proof is left to the reader. 


Exercises 


Test the following series for convergence or divergence. 


1 . 

2 . 


1 1 

1 1 


1 1 
1 + -p + -p 


+ • • • 


+ ••• 


+ ••• 


5 . 
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4. ar + ar^ + ctr^ + * * • + + • * • , 0 = r. 

5. r + +-^ + •••, 0 ^ r. 

2 o 


6 . 


a:- + 



+ ••• 


7. 

8 . 


1 + ■' 1 + X* 1+ :c “ 

Prove the theorem: — Given the series 


T +• 


“o + “i ^ . 0 S u„, m ^ n. 

If n u„ approaches a limit as n becomes infitute, and if this limit is 
positive, the series diverges. 

9. Show that the series 


— i j 1 1. . . . 

1 + 2 + z 

diverges for all values of x for which it is defined; 

— oo cC z < 4* oo, X ^ — 1, — ' 2, • • 

10. Given the series: 

Uq + Ui + — ‘ , 0 S Unv m ^ n. 

If y'^ Un approaches a limit as n becomes infinite, and if this limit 
is less than 1, the series converges; 

lim 1 ^ i/ii = y < 1. 

But if y > 1, the series diverges. 

11. Given a power series; 

iZq + ajz + ^ 2 ^^ H , 0 < a^i, m ^ n. 

Let 


lim ^ an == p > 0. 

n»» 

Then the series converges for all values of x such that 0 ^ z < 1,'p. 

What if dn becomes infinite? 

12. Given a series: 

■* 

Mo + Ml H i 0 < M„. m ^ n. 
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If 


log- 


n„ 


^7*4-1 


> y. 


m ^ fjL ^ n, 


where -y is a positive constant, the series converges. 

§3. A General Test-Ratio TesL Let 

^0 + H 1 0 < an, m ^ n, 

be a convergent series, and let 

+ Wi 4- * • ‘ , 0 < m ^ n, 

be a series to be tested for convergence. If 

Un±i_ m ^ n, 

Un an 

the u-series converges. 

Proof. By hypothesis, 

^m+l 


Um 


Ut 


•mfi 


ttm 

^m+2 

«m+i 


tt-m+k < 

Wm+A— 1 1 

Multiply the k inequalities together. Thus 

Um-^k < tlrn-^k 
Um 


Um 

Um 


The factor Um/Um is a constant. Hence the series whose general term 
is {um/Um) Un Converges, and consequently the M-series converges. 

In the proof, we have made use of the theore.m that if each of 
two variables approaches a liniit, their product approaches a limit. 
The proof of this tbeorem will be given later. 

DiVERCiENCE Test. Let 

0 4 * 4 * • • * » 0 ^ Un^ 


m ^ n. 
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he a divergent series, and let 

Mo + Ml H , 0 < M„, m = n, 

be a series to be tested for divergence. If 

_£ 2 ± 1 _ ^ , m ^ n, 

an Ufi 

the U' series diverges. 

The proof is similar to the foregoing, and can be left to the 
reader. 

To illustrate these theorems, let the ^z-series be the geometric 
series 

a ar -Y ar^ + ••*, 0 <. a, 0<r<l. 

Then 

^n+\ _ ^ 

We are thus led to the familiar 
First Tfst-Ra.ito Test. If 

^0 "h "h * * * . 

be a series whose terms from a definite point on are all positive., 
and if 

lim =rr <.l, 

n~x Uji 

the series converges. But if r > the series diverges. If r = 
there is no test. 

For, we can choose r between r and unity, r <. r <. 1, or 
1 < r < r, and then the hypotheses of the general theorem will 
be fulfilled. 

If r = 1, the M-series may converge and it may diverge, as is 
seen from the two examples: 

11 

1 ^ + -gi + ” ’ (convergent) 

1 1 


(divergent) 
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Exercises 

1. Show that, if 

lira log — ^ — == <r, ( 0 < m ^ n) 

7v=»» Un+l 

the series converges when <r > 0, and diverges when or < 0. 

2. Show that if 

1 g J^!±L_, (0 < m ^ n) 

Un 

the series diverges. 

§4. Cauchy’s Test by Integration. It happens in simple 
important cases that the function Un of the discrete variable n admits 
useful interpolation for a continuous argument x. Thus 

111 

71 ’ nP' 72 log 71* 

are interpolated by the continuous functions 

1 1 1 
» , - t etc. 

X xP X log X 

Cauchy devised a simple method for determining the convergence 
of such series. 

Convergence Test. Let f{x) be a positive^ continuous^ de- 
creasing, monotonic function, 

f{xf) ^ /(x'O ^0, xf < x". 

Form the integral 

oo 

f f W dx. 

t 

If this integral converges, the series 

Uo + H 

converges. If the integral diverges, the series diverges. 

The proof follows immediately from inspection of the figure, 
p. 10. For obviously 

m+r oo 

f{,x)dx g f f{x)dx. 


«m+i + ^m+2 + ’ ' ’ + 
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J 






□ 

b 


When this last integral converges, the sum satisfies the hypotheses of 
the Fundamental Principle of 
A being the value of the 
integral, and so the series con- 
verges. 

On the other hand, *01 m m+] m+r 

m+r 

^ f ('^) 4" 4" ' * * 4" 1 • 

m 

If, then, the integral diverges, the series diverges. 

Example. Consider the harmonic series, 

, 1 1 

Here, f{x) — l/x, 

= log X — log m. 
m 

Hence the integral in question diverges and the series diverges. 

On the other hand the series 

leads to the function \/x^ and to the integral 

X 


r dx 


1 

1 1 

J xf 

1 

. 771^1 

x^-1 J 


The crucial integral is thus seen to converge, and so the series 
converges. 

Appraisal of the Error. Cauchy was much interested in 
appraising the error made in computing the value of a series, when 
one breaks off with the m-th term. Let 

[7 = Ml + U2 4- * • • = 4- r„ , 

rn = W/i+i 4- 4 , 


oo 

=ff{x)dx. 
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Then 

T/n s ^ s r m— 1 • 

But 

^ m— 1 ““ ~ Um • 

Hence we obtain the following formula for the appraisal of the error: 

rm^ A ^ Bum, 0 < ^ < 1 . 

Thus 

^ — BUm , 

and we may stop adding terms as soon as we come to one which is 
less than the limit of error assigned. 

Consider, in particular, the series: 


QO 

s 

n«»l 




1 < p. 


Here, 

1 1 . 

”* (m-hl)^ (m-1-2)^ 


A == C ^ = JL i 

J xP p-1 ' 


Thus the error made by breaking off with the m-th term: 


. 1 1 1 

1 d" ~ ~ -h * * * H ^ » 

2 ^ 5 ^ mP 


is given by the equation: 


_4. ‘ 


p— 1 


P ’ 


and 


U = 1 + -1 + . . . + _L_ + _J \ ?_ 

2'’ ^ mf p-\ m'’ 


1 




^ 2!’^"'^ {m-\)P ' p-\ 

0 < «' < 1 . 


Let it be required to compute the value of this series for p = 1.01 
correct to . Here the first term less than ^ is 10”*A Hence 
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Sm-l - *9 - 1 + -^1 + ■ • • + . 


A has the value: 


A = 


1 


1 


0.01 


= 97.72, 


and it remains to compute the sum . 


Exkrci ks 

1. Show that the exact computation of the term Um can be 
avoided by using the formula: 

rm->\ = ^ + Qum, 0 < d < 1, 

where A has the same value as before, but B is different. Thus 
U = Sm-~i A BUm • 

2. Study the series 


, 1 1 


when J3 = 1.001. How many terms must be taken, in order that 
the error made by dropping the remainder may be less than 1 ? How 
many, if the approximate formula for the remainder be used? Com- 
pute the value of the series correct to the nearest integer. 

3. Show that the series 


— 1 f 1-.. . . 

2 log 2 3 log 3 

diverges. 

4. Show that the series 


^ + -7 • •. 1 < P, 


2 (log 2)/’ 3(log5K 


converges. 

5. Treat the series 


1 


^ 71 log n (log log Tl)^ ’ 

and generalize. 

6. Apply Cauchy’s test to the geometric series, 

+ 0<fl, 0 < r. 
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7. Prove the theorem: — Given the series: 

Wo + Wi H , 0 ^ m ^ 72. 

lirn Un = 0, 1 < p, 


the series converges. Here, is a constant. 
8. Show that the series 

_L_ + _1_ + _L_+... 

1 + 2/’ + T dP +-X ’ 


1 < p, 


converges for all values of x for which its terms are defined: 


CO < j: < 4- oo, 


X ^ -U — 2^ —3^, 


§5. Tests in Case lim Un+ifun = 1. When 


Wn+l _ 


the First Test-Ratio Test fails. For example, if 




limi^= 1, 

Un 


regardless of the value of p. Now, if p is very large, 101^®’ say, 
the early terms of the series drop off rapidly. But the convergence 
of this series cannot be established by comparison with a geometric 
series, 

4 < 

For, no matter how large a be taken, and no matter how near to 
unity r < 1 may be chosen, the inequality will ultimately point the 
other way, since 

lim r' = 0. 

X=ao 

It is easy, however, to develop limit tests which will apply to 
series which converge or diverge commensurately with the series 

T-1-. 

^ nP 


(n + 1)^ V. 71 / n 


Here, 
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where r„ is of the order 
Hence ,* 

limn fl - = p. 

\ an J 

Consider now a series such that 

limn fl =p. 

First, let p > 1. Choose 1 p < p. j p p 

Then, for large values of n, the variable ^ ^ ‘ 


n (l ^ P 

and 

n f 1 will be near p, 

\ Un J 

Hence 

71 ^ 1 < M 1 ^ m ^ Tly 

\ an f \ Un f 

and thus 

^+1 ^ ^n+l „ 

c;^ ^ YYl Yl, 

Un ^71 

We see, then, that the iz-series converges. Similarly, if jt? < 1, 
it appears that the w-series diverges. We are thus led to the following 
Second Test-Ratio Test. Let 


Wo + Wi + • • * , 0 < W;,, m ^ n. 


♦ It is not necessary to base this result on the binomial series, or even Taylor’s 
Theorem with the Remainder (carried to the quadratic term). Write 


Now, the limit 



n 


Hm 

r=0 ^ 


is shown at once by the C^culus to be — p, and we are through. 
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be a series such that 


liai n{\ ) = a or -f oo or — oo. 

n=.a« \ / 

If p > 1 or + cxD, the series converges. If p < 1 or — ob, the 
series diverges. If /j = 1, there is no test. 

The test for divergence can be made somewhat sharper. For, if 


n(\ - g 1, 

V Un ^ 


then 


Un 

n - 1 < Un^i 
n Un 


m ^ n. 


On the left stands the test-ratio of the harmonic series. Hence the 
u-series diverges. 

Exercises 

In the following exercises, 

Wo + Ml + • * 

shall be a series whose terms ultimately become and remain positive. 
(It would do as well, of course, if the terms were ultimately to be- 
come and remain negative.) 

1. If 


lim r 71 — (n -b 1) — = cr or -f oo or — oo, 

n=oo L Wn J 

show that the series 

i) converges when cr > 0 or -f oo; 

ii) diverges when or <C 0 or — oo. 

2. If 


lim n log — = <r or -b oo or — oo, 
Un+i 

show that the series 

i) converges when o’ >- 0 or + oo; 

ii) diverges when O’ < 0 or — oo. 

3. If the test-ratio is of the form: 


= 1 _ -i + r„, 
Un n 



16 


FUNCTIONS OF REAL VARIABLES 


where 


lim /i = 0, 

7J=»JO 


and c is a constant, show that the series will converge if c > 1 and 
diverge if c < 1. 

§ 6* {Cummer’s Cntenon* One of the earliest attempts to 
obtain general criteria for convergence and divergence is found in a 
paper by Kummer* of the year 1835. Let 


1) Wq -h + * * *, 0 Um m ^ n. 


be a series to be tested for convergence. Let P^, Pm+i, * * * and a 
be any set of positive numbers. Form the expression: 


2) 


Gin = 


a \ a 



^+1 * 


On writing this equation for n = m, m + 1 , * * • , m + r — I and 
adding, we find: 

3) Gim “f" 03/n+i 4" * * * + OOm+r— 1 ~ 


P m 
a 


P m+r 
a 


l/m+l “* Wm4-2 ‘ * Urn-\-r’ 


Hence 

4) 


P m 
a 


Wm+l 4 " W/714.2 4- • • • 4 “ Um-\-r — 

P m+r _ 

a)/n Wm+l OOm+r— 1- 


Lf.mma. If positive numbers Pm, Pm+i, a positive 

number a, can be founds such that Gin ^.0, m = n\ i.e, if 

5) 0 ^ - (—^+1- + 0 < «„, m ^ n. 


then the u-series converges. 

For, from 4) we infer that 

Um+I 4- h Um+r < ’ 

and since the right-hand member is constant, the theorem is proved. 
The condition 5) is equivalent to the following: 

6 ) Q P„-^- Pn+i. 




Journal fur Mathematik, vol. 13 (1855) p. 171. 
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This condition will surely be fulfilled whenever 
^+1 

approaches a limit and this limit is positive: 

lim (■ P„+, 1 =<r > 0. 

For, it will then be possible to choose an a between 0 and o , and 
so, from a definite point ^ m on, we shall have 6) holding. 

We are thus led to the following test for convergence, which 
however, without any restrictive hypothesis relating to the signs of 
the terms, applies to any real series. 

Test for Convergence. Let 

Wo + + * • • 

be any real series. If positive numbers Pm+i, * * • can be 

found such that the variable 


n — t'n+\ 

Wn+i 

approaches a positive limit or, or becomes positively infinite: 


lim \Pn 

71=00 L 


j = GT > 0, or = + oo, 


then the u-series converges. 

For it is obvious that Un/Un+i must ultimately become and re* 
main positive, cuid so the series, from a definite point on, must have 
its terms all of the same sign. 

Test for Divergence. Let 

Wi 4* Wo + * * • , 0 < Mn> m ^ n, 

he a given series. Let Pm, Pm+i, — be a set of positive numbers 
such that the series 

8 ) W ^ " 

■tr m Jr m-Ei 


diverges. If the variable 


Pn - Pn+l 
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approaches a negative limit it or becomes negatively infinite: 

9) lim P,Hi } = ff < 0, or = - oo, 

n=3o L ^+1 

then the u-series diverges. 

Proof. From a definite point on, n ^ ft ^ m^ we shall 
have : 


Pn -,1 < 0. 

^+1 


Hence 


Pn 




ft ^ n. 


P n+l ^ 

But the left-hand side is the test-ratio of a divergent series, 8). This 
proves the theorem. 

A sufficient condition for divergence is, that 


P n tin Pn+i ^n+l = 

provided the series 8) diverges. 

A set of useful choices for P„ is the following: 

1. Pt, = 1. This gives the First Test-Ratio Test. 

2. Pn = n. This gives the Second Test-Ratio Test. 

3. Pn’=^ n log n. This given the Third Test-Ratio Test. etc. 


Exercises 


1. Assuming that the series 



y — ^ 

^ n log n ’ 




1 

n log n log log n ’ 


etc. 


have been shown to be divergent by Cauchy’s test, § 4 — or otherwise 
— apply the Second, Third, etc. Tests for Convergence and Divergence 
to the series 



V ^ 

^ n (log 


n log n (log log nY ’ 


§ 7. Continuation* Discussion* Given any convergent series 
1), it is always possible to find a set of positive PnS and a positive 
a such that <On ^ 0. *!For 3) is equivalent to the relation 
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P m^r W/n+r ^ Pm 
— a H" COmfi + ’ * ‘ + tom+r -1 

+ Um^i + Um+i^ + * * * + Um>^r)- 

If,, then, a>n S 0 is the general term of a convergent series, <2 > 0 
can then be so chosen that the right-hand side of the equation will 
always be positive, and Pm+r can then be determined from this equa- 
tion {Pm > 0, arbitrary' at the start). 

Moreover, the Pn and a can be so determined that 

Pn—- Pn+i 

will approach any positive limits <r. For, let 

COn = 

and determine the Pn accordingly. Then 2) gives 


and it is sufficient to set = or. 

Secondly, given any divergent series 1 ), a set of positive P„\y can 
be found such that the series 

Pn 

diverges and the variable 


s 


Pn 




-P. 


rt+1 


approaches an arbitrary negative limit, or. 

In fact, we need only determine the PnS from the relation : 


= < 0 . 

Here, 

P n+l ^^72+1 ~Pn*^« + ( O') . 

From this equation foUows: 


P/n-j-r W/n+r — Pm Um + ( <^ ) (W/w-j-i “h ’ * * -f" Z^m+r)* 

Thus a set of positive PnS is determined. Will the series 
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diverge? It For, strike in anywhere and add terms: 


Let 

Then 


1 




= Pm Wm + (— Cr) (Wm+1 + * * * + W{i). 


1 


-f 


t^+l 


1 

^{a+2 




A + {-a) (uix+i + ■ 
1 


■ + Up.+k) 


+ •" + 




Ujt+i -h 4- • • • -f ntHP 

A 4- (~cr) "h UiL+2 + * • * -h 

By taking /o large enough we can bring this last fraction as near to 
l/( — cr) as we please, and so, in particular, make 

_J_ _i_ >_L_. 

-^^.+2 2(--cr) 

Hence the series 2 l/Pn diverges, and this completes the proof. 

To sum up, then: An arbitrary series, 0 <. Un, m ^ n, can 
be proved conveigent by the Convergence Test, or divergent by the 
Divergence Test, if the P^s be suitably chosen. 

Thirdly, ior the divergence test, it is not enough to demand 
rnerelv that a set of positive P^s can be found such that 


p 

-r n 

Wn+I 


— P w+i 


approaches a negative limit. For, if the w-series be a convergent 
series of postive terms and we determine P„’s as in the leist case, 
these Pn’s will all be positive. But the series S l/P„ will now 
converge. 

§ 8. Alternating Series. TutOREM. The series 

Wo — + Mo » 0 ^ M„, m ^ n, 

converges if 

i) Wn+i = Wm m ^ n; 

ii) ^ lim Un = 0. 


W=3jo 
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1 ) 

2 ) 


Proof. Form the su:ns: 

52„ = - Z/l) + * • • + 

-^ 271+1 ~ ■“ (^^1 ^ 2 ) ’ ■ i^2n-l 


Observe that, since 


•^‘2«4*l ’^2/1 ~b 


■>‘2« = ^2n+l 


Sq 52 ^3 


Now, .90,, Steadily increases with n, or remains constant; and s^n ■ 1 
steadily decreases with w, or remains constant. It follows, then, that 


3) So„ — 5^. 

Conse(|uently, by the Fundamental Principle of § 2, ^ 2 ,, approaches a 
limit: 

lim .92,, ^ Ui, 

7;=30 

Similarly, approaches a limit: 

lim S 2 n+l =^72. 

Finally, because of i) and ii), these two limits are equal: 

L\ = U 2 , 

Consequently Sn approaches this common limit, U : 

lim Sn = U, 

n=?o 

and tlius the tlieorem is proved. 

The Error. Since 5„, with increasing n, continually jumps over 
its limit U (or coincides with it), we see that the error due to 
breaking the series off at any point, does not exceed nurnericcdly the 
value of the first terjn in the remainder. 

Examples : 


a) 



1 



b) 

c) 
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d) + • • • 

log log 4 log log 5 

How many terms of the first series are needed to obtain the value 
correct to how many of the last? 

§9. Series with Positive and Negative Terms at Plea- 
sure. Let 

1) Wo 4 H 

be any series whatever. Set 

(T m ^ 4 t^o 4 * * • 4 Vm, 

Tp — w'l 4 H — * 4 Wp, 

where Vi, * • * denote the positive terms, taken in order as they 
come, and where the negative terms are — wi, —‘W 2 y •*• . Then 


Wo 4 Ml H h Un^) 


can be written in the form: 


where, in particular, if no positive terms have appeared, we agree to 
write 0*0 = 0; and similarly for tq, 

AlS n increases, the series 
5) i;i -f i;2 4 • • • 

4) 1^1 4 w»2d — • 

may converge or they may diverge — it is not necessary to think of 
the case of a finite number of positive or negative terms as an ex- 
ception, for any sum may be regarded as an infinite series, all of 

w'hose later terms are 0. Thus if 1) is the series 

5, + 

both the series 5) and 4) diverge; but 5) converges by § 8. It is 
clear, however, that if both the series 5) and 4) converge, the vari- 
able Sn will approach a limit because of 2), and so the series 1) 

will converge. We are thus led to the 

Theuhkm. a sufficient condition for the convergence of a 


Wo 4 Ml 4 * 
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is the convergence of the series of absolute values : 

7) I wq I 4* 1 wi 1 + * • • 

^roof. Let 

•Sn = I “o 1 + I “l I H H 1 U„_1 1- 

I’hen 

“ O'm 4" “Tp. 

Let A be the value of 7). Then 

(Tin = A^ Tp = A^ 

and hence, by § 2, both the series 3) and 4) converge. 

A series 1) whose absolute value series converges is said to con- 
verge absolutely ^ or be absolutely convergent. Other convergent 
series are called conditionally convergent. In the case of these latter 
series, both the series 3) and 4) diverge. It will be shown later 
that the terms of an absolutely convergent series may be rearranged 
at pleasure without changing the value of the series. But if the 
series converges conditionally, a new series can be constructed from 
its terms, which will converge toward any preassigned value what- 
ever, or diverge toward -hco, or diverge toward — oo; Chap. VII, §2. 

Test-Ratio Test. If the series 

Wq 4- wi -1 , 7 ^ 0, m ^ n, 

he giveny and if its test-ratio / Un approaches a limit : 

Um = r, 

l v =ao Un 

then the series 

i) convergeSy if | r ] < 1 ; 

ii) diver gesy if 1 r | > 1. 

Proof, If I r 1 < 1, the series of absolute values converges. For, 

and the left-hand side of this equation approaches a limit, namely, 

lr|. 

If, on the other hand, 1 r | > 1, it follows that Un does not 
approach 0 as its limit. For, from ^e proof in § 3, | Un I does not 
approach 0. 


- I I 

Un \Un\ 
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The more refined test-ratio tests of § 5 help in establishing the 
absolute convergence of a series, but are useless if the series converges 
conditionally. 

Finally, we observe that it is sufficient for convergence to de- 
mand that 


Un 


< y < 1, 


m ^ 


vvhere y is a constant; i.e. not to impose the restriction that a limit 
exists. But the limit form is the one that is useful in practice, and 
for that reason should be given first place. 

Comparison Tfsf. Let 


-1 

be a series to be tested for convergence^ and let 

^0 + H , ^^71 =7^ 0, m ^ n, 

be an absolutely convergent series. If Un/Un approaches a limit: 


lim — — exists^ 

n=3® Uji 


then the u- series converges absolutely. 

For, since Un/an approaches a limit, it follows that 1 j / j I 
must also approach a limit. Denote the latter limit by L, and 
choose L' > L. Then, from a definite point on. 


i I 


Hence 


< L', 


tJ-n 1 ^ H I tljx 


The series whose general term is this last expression converges, and 
this fact yields the proof. 

DivF.H(ii:N(.i: Tlst. Let 

Mo + wi H 

he a series to be tested^ and let 

Mo + Ml H , 0 < m ^ n, 

be a divergent series. If Un/Un approaches a limit not 0: 


lim = L ^ 0, 

n=sso Cn 


then the u- series diverges. 
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Exerctsks 


Test the following series for convergence: 

1-2 1 - 2 - 5>4 

100 “ 100 ^ 100 * 



8 . 

9. 

10 . 


11 . 


12 . 

13. 


cos X cos 3 jc cos 5x 

- 3 r- + - 5 r- 


1 + 2a: -h 3a:“ + 4a:^ -f- ■ 


0:2 ^3 

X 4 

2! 3! 


r\ "E 


i/T l/T 


x'^ . x'* 

X — + -- 


V 3 


V 5 


V a. l^a + IT Voi + 2 r 

log (1 -f r) + log (1 + r^) + log (1 + r^) + • • •, 


< 0 -. 


14. 


0 g r. 
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15. log ( 1 + y) + log ( 1 + -|) + log ( 1 + y) + • • , 0 S X. 

16. log (l - y) + log (l - ^) + log - fj) + • ■ 

§10. Infinite Products. Let / q , • • • he any set of numbers 

proceeding according to a definite law. Form the product 

Pn ‘ ‘ fn-i^ 

If /n 7 *^ 0, m = n, arid the variable 

r — fm • * * * 'fm+r-^\ 

approaches a limit different from 0: 

lim Pniy r ^ m ^ 

r=oo 

then the infinite product 

fo-fi • • • 

is said to converge and the number 

P = lim Pn 

/3=3X) 

is assigned to it as its value: 

P=foflf2---- 

For example, the infinite product 

L5 2-4 3*5 
2-2 ’ 5*3 * 4-4 ‘ " 

converges, since the product 

_l-3 2*4 + l 

2-2‘3-3"'”’\ r-r ) 2 r 

approaches a limit different from 0, and so 

JL = 1:1. 111. 1:1. . . 

2 2-2 * 3*3 ’4*4 

On the other hand, the infinite product 

1. A A 
7 T’T”* 

diverges. For here 
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_ 1 . 2 . . . , r ^ 1 

2 ' 5 r + 1 r + 1 

approaches the limit 0. 

These high handed definitions are surprising. Their justifica- 
tion lies in the demands of practice. There are no infinite products 
with an infinite number of vanishing factors in any known domain 
of mathematics. To admit such for consideration would complicate 
the theory — cui bono? — Again, to admit as convergent an infinite 
product which vanishes without any one of its factor’s vanishing 
wnuld break wdth the analogy with the products of ordinary algebra. 
For these reasons, and others, we have thrown such infinite products 
into the discard of divergent products. 

From ihe definition of convergence follows immediately that the 
factors of a convergent infinite product ultimately become and remain 
positive. 

Tm:oHKM. A necessary and sufficient condition for the con- 
vergence of an infinite product: 

lies in the convergence of the 'infinite series: 

log/m + log/m^l -f • • % 
where m is suitably chosen. 

a) The condition is necessary. Hypothesis: the product con^^ 
verges, or 

Pm^r ^ fm '/m+i fm-k-r 1 

approaches a limit not 0; moreover, m may and shall be so taken 
that yii > 0, m = n. Conclusion: the series converges. Proof: let 

Sr = log^m + logy^+l H- • * • -+- logy^_|.r-.i. 

Then 

Sr = log Pm., r- 

Since pm, r approaches a limit P„i > 0, and since log is a con- 
tinuous function, it follows that log pm,r approaches a limit, and 
hence the series converges. We observe in passing that 

log Pm = log/m + log/m+i “h * * * 

b) The condition is sufficient. Hypothesis: the series converges; 
i.e. lim v exists. Conclusion: the product converges. Since 
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pm , r — 

and since ^ is a continuous function, it follows that approaches 
a limit: 

lim , 

r=3o 

where 

Sm = log^m + log/Wi + * * * . 

Finally, this limit cannot be 0 because the exponential function is 
positive for all values of the argument. 

Corollary. A necessary condition for the convergence of an 
infinite product is, that 

lim fn = 1. 

For this reason it is often convenient to set 
fn = ^ tin- 

Thus the infinite product appears in the form: 

(1 + ao)(l + 

Convergence Test. A sufficient condition for the convergence' 
of the infinite product 

(I + (1 -F fli)* • • 

is the absolute convergence of the series: 

^0 "h “F • • • • 

We may omit any factors in which an = 0, since such influence 
the convergence of neither the product nor the series. 

Consider the series : 

log(l + tfo) + + ^i)H 

Apply the Comparison Test of § 9. Since 

x=0 X 

exists, it follows that log(l 4- cLj^/CLn approaches a limit as n becomes 
infinite, and so the series of logarithms converges. Hence the infinite 
product converges. 

It is not true that the mere convergence of the a-series will 
insure the convergence of the product For example, the product 
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is easily seen to diverge by use of the series of logaiithms. But the 
series 

V 2 v~^ 

converges. Nevertheless, if the d!% be restricted not to change sign 
we can obtain a divergence test. 

Divergence Test. If 

^0 + ^1 “b * * * 

is a divergent series whose terms from a definite point on are all 
of one sign, the infinite product 

(1 + tfo) (1 + fli)* • 

diverges. 

The notation for an infinite product is; 

n=0 


Exercises 


Test the following infinite products for convergence. 


5. 

4, 

6 . 

6 . 


oo 



oo 


n 


(■ 

(' 



4,r® \ 

(2n + if) ■ 



SC' 



+ 



— X 
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7 . Study the Binomial Series: 


4 1 I ^ 0 I 

1 4* mj: + + * ’ *, 


determining its convergence in aJl cases. 
8. Show that the infinite product 


{a + Ti){b + n) J 


diverges toward + oo when r < — 1 ; converges, when r = — 1 ; and 
diverges toward 0 when — 1 < r. 

§11, The Hypergreometric Series} 


F {a, c, x) = 1 4 - 


c-1 ^ c(c+ 1)1-2 


This series includes some of the important elementary functions j 
but it also defines a class of more general functions, which arise not 
infrequently in practice and whose properties have been studied by 
means of the theory of functions of a complex variable. 

Some simple specializations of the series are the following, 

(1 4- = F ( - n, b, b, - x); 

log (I 4- x) - xF(l, 1, 2, - x); 


tan""^ X = X 





= lim jF f 1, 2, V 

N b f 

We propose to discuss the convergence of the series in all cases, 

First of all, we must impose the restriction: c ^ 0 , — 1 , — 2 , • • • , 
for otherwise no series is defined. 

Next, when either or Z> is 0, —1, —2, « • *, the series breaks 
off with a finite number of terms, thus reducing to a polynomial, 
and so, considered as an infinite series, converges for all values of x. 

There remain, then, the cases: 

a^b, c ^ 0, —1, —2, * • • 

For what values of x 5^ 0 will the series converge? 
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The general term is easily formulated: 


Thus 


a {a d- \)' ' '{a n — \)b{h \)' ' '{h n — 1 ) 

_ {a -f /i) (^ + n) ^ 

Un {C -f «) (1 + A?) 


Its limit is jr, and so the series converges absolutely in the interval 


-1 < :c < 1, 

and diverges outside this interval. 

There are still two points in doubt, namely a: = + 1 » — 1 , for 
each of which the test-ratio approaches the limit 1. 

The Point x ~ -H 1. Here, we can use the Second Test- Ratio 
Test in Rummer’s form, § 6. Since 

Un (c -h n) (1 d- n) 

Un+i ia ^ n){b n) 

we have: 




, ,\^{n-\^\)[{c — a — h)n — ah] 

^ ^ ’ {a^n){b^n) ' 


and thus tr is seen to have the value: 

cr ■=^ c — a b. 

Hence if 

0 <I c — a -- b^ the series converges; 

c — a — b <. 0, the series diverges. 

When c — 0, the test fails, and we proceed to the next 

test. Here, 


n log 77 n-hllogn-hl = 

f^n+l 




— (n -f 1) l^loo (77 -p 1) — log 77 + - 

The lijnit of this variable is seen to be 
series diverges. 


a b log n 1 

{a n){b + n) J 

— I, and consequently the 
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To sum up, then; In the case :r = + 1 we have 

i) Convergence, when 0 < c — a — 5; 

ii) Divergence, when c — a — h ^ 0. 

The Point = •— 1. Here 


_ (fl -f n) + n) 

Un (c + 72) (1 + 72) ’ 

and the series ultimately becomes an alternating series. When 

0 < C — 22 — 5, 


the series converges absolutely. When 


we have: 


where 

Let 


c — £2 — 5 = 0, 

Imh+iI _ J _ (1 + r)n + {c- ab) 
|unl (c + n) (1 + n) 

r = c — 22— 


Then 


(1 -f r)7i + (g —ab) 
(c + 72) (1 + 72) 


(1 + <*m)(l + 22mH)' * *(I + /2m+*-l). 


The infinite product 


n(i + 

n=*m 

diverges toward + oo when r <C — 1, and consequently u„ does not 
approach 0 as its limit; the m- series diverges. 

When r = — 1, the infinite product converges, and again the 
M-series diverges, for the same reason as before. 

But when r > — 1, the infinite product diverges toward 0. 
We have: 

i) <1, ^ < n; 

I Wnl 

ii) lim Un== 0, 

Consequently the i 2 -series converges conditionally. 
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To sum up, then: — When x = — 1, we have 

i) Absolute Convergence, when 0 < c a — h\ 

ii) Conditional Convergence, wlien — 1 <. c — a — b ^ 0; 

iii) Divergence, when c — a -- b —1. 

The student should supplement his work on this chapter with a 

fresh and carelul study of the chapter on Infinite Series in the 
Author’s Introduction to the Calcuhis (Chap. XIV) and also with a 
renewed study of the chapter on Indeterminate Forms in the 
Advanced Calcidiis (Chap. X.) 



Chapter II 

The Number System 

§1. The Problem. We take the natural numbers 1, 2, 3, • • •, 
for granted. We think of them as collections of individuals, like a 
bag of marbles; but we define them as marks, like 1, 2, a, b, etc. 
1 he representation of such a number by means of a base, as: 

547 = 3 X 102 + 4 X 10 + 7^ 
is not a part of the concept, number. 

We assume the idea of addition as known, whereby out of the 
two numbers, a and b, a third is formed: 

c = -f 

We think of two bags of marbles emptied into a third bag. 

Furthernjore, we define subtraction as solving the equation: 
a X by when a <, b, 

and write : 

X ~ b — a. 

Multiplication we also take for granted. By ab we mean the 
number b added a times: 

ab — b b -Y b (a times) 

Divison consists in solving the equation 

ax = by 

when is a multiple of a. 

It will also be cxjnvenient to point out that both subtraction and 
division, when possible, are unique; and furthermore to adjoin the 
theorem (proved by Euclid’s algorithm of the greatest common divi- 
sor) that a natural number can be represented in one and (except 
for the order) but one way as the product of its prime factors: 



A corallary of this theorem should also be noted: — If a and b 
are relatively prime to ^ach other, and if ac is divisible by b, then 
c is divisible by h. 
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Inequality. We also assume as known what is meant by a <. b, 
/i > b, and point out that 

i) if a •< b, then b '> and conversely; 

ii) \i a <. b <C then a <, c; 

iii) ii* a <. b and c <. d, then a c < b d\ 

iv) if** a <. b and c <. d^ then ac <. bd; 

v) if -< b, then na > b, for a suitable n. 

The Formal Laws of Algebra. For the numbers and the pro* 
cesses above considered the following laws hold without exception: 

I. A A B = B A A^ Commutative T.aw for Addition; 

II. Aa{B-\-C) = {A-\-B)-^C, Associative Law for Addition; 

III. A B = B Aj Commutative Law for Multiplication ; 

IV. A[B C) == {A B)C\ Associative Law for Multiplication; 

V. A {B A C) = A B + A C, Distributive Law. 

By an algebraic equation is meant an equation of the formif 

a^o(^ -\r ^ H h 

where the coefficients are any nujnbers of the particular domain in 
question. 

This equation includes the equation 

1) a ^ X ~ b, 
which w^e iriet in defining subtraction; and also 

2) ax ^ b, 
appearing in division. 

We now proceed to extend the number system n so that Equation 
2) will always admit a solution. 

The Concept: Number. What is a “number”? We have been 
so used to the numbers 1, 2, 3, 4, • • • from earliest childhood; that 
we take them for granted; and also the simpler fractions, like I , J , I . 

* a ^ h and c ^ d., where at least one of the upper signs holds, then 
a + c < b + d. 

** li a ^ b and c ^ d^ where at least one of the upper signs holds, then 
ac bd. 

f Later, when the number system has been enlarged to include the number 
0, we shall set ft = 0 and require that ao 0. 
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But what is •)/— 1 ? The answer lies in the concept of a class 

of objects, or as it is sometimes technically called: a logical class. 
The whole numbers are a case in point; for,' any two numbers, a 
and of this cIelss are either equal or unequal. And for the objects 
of this class we have two processes — addition and multiplication, 
whereby respectively any two objects, a and determine a third 
c(=^-t-£> or = ab). 

Now, we proceed to enlarge this class — or, better, to define a 
more comprehensive class, containing the whole numbers as a sub- 
class — our object being to provide ourselves with a number system, 
i.e. a logical class, in which addition and multiplication are defined, 
such that, whatever numl)ers a and b may be in the new system, 
division is always possible; i.e. Equation 2) always has a solution. 

§2. Fractions. Consider the logical class, or set of elements, 

(m, n), 

where m, n are any natural numbers. The element is the mark 
(m, n) itself, and we will spesik of it as a number and refer to it 
by a single letter, as 

A = (fli, %), B = {bi.b^), X = (x, j), etc. 

Equality. Two numbers, A = Oo), B = (^i, shall be 
said to be equal, when 

We write 

A :=B. 


It follows from the definition that if 

A^B 


then 
and if 
then 


B^Ai 

A = B, B = C, 

A^C. 

U A = (m, n), then does A also = (X m, X n), where X is any 
natural number; and also, in case m and n are both divisible by X: 
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Let X be so chosen that 



are prime to each other. Then 

A = 

is said to be in reduced^ or normal form. 

If jB = b^) is any number which is equal to Ay 

A = By 

then bi = fL m', bo = it- n', 

where p. is a natural number. 

Inequality. We say that 

{m,n) < (m',n'), 

when 

mn' < m^n. 

Relations i) — v), § 1, sire then seen to hold in the present system. 

Addition.* By the first combination {erste V^erknupfung) we 
mean the following. If ^ = (^ 1 , ao)^ B = {b^y bo), then 

A 0 B = (^1^2 + ^2^1, ^ 2 ^ 2 )* 

(Read: ''A with 5”.) A “combination” is essentially a function of 
two variables: /{AyB), having properties which result from the 
specific definition. 

The Commutative and the Associative Law follow at once: 

l . A®B=B@A; 

II. -^0j-B0C} = j^0-Bj©C. 

Multiplication. By the second combination we mean: 

A (x) J5 = (<Zi bi, ao h^. 

It is also commutative and associative: 

m. A ® B=^B ® Ay 

IV. A ® \ B ® C \ = \ A ® B \ ® C. 

Finally, the Distributive Law holds: 

V. A ® \ B ® C \ ^\ A® B \ ® \ A ® C\. 

Proof, by direct computation. 


* It would be bettor to consider first multiplication, as being simpler. But such 
an order is less in harmony with the procedure in the later cases. 
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Division. We are now in a position to prove that division is 
always possible and unique. Given the equation: 

1) A ® 

to solve for X = (j:i, x^). 

Here, we have as a necessary and sufficient condition: 


2) 

h 

— Uo b^ X2» 

Obviously, 

one solution of 2) is: 


Let 

Xi = 

II 


Xi = X , 

X^ “* X x^ , 


where x [ , Xg are prime to each other. And now the number X = {x [ , .r^) 
is seen to be a solution of 1), and the only one, any two numbers 
that are equal being regarded as identical. For the most general 
solution of 2) is xi ~ ^ x[ , -^ 2 » 2) is both necessary and 

sufficient. 

IdemJ actor. There exists a number / = (1, 1) such that 
I ®A = A, A ® 1= A, 

where A is any number of the system; and only one such number. 

The Natural Numbers as a Sub-Class. Within the present 
class of numbers there is a sub-class which can be identified with 
the natural numbers. If we associate the number (a, 1) with a: 

(a, 1) . ' a, 

then the first and second combinations will also correspond respectively 
to addition and multiplication. For, if 

(^,1) © (^,l) = (c, 1) 

then a + ^ = C; 

and if 

[a., 1) [b, 1) = (c, 1), 

then ab — c. 

We can, thei*efore, replace the number (fl, 1) by a in all com 
putations, and furthermore write, as a matter of notation: 
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Thus the present class reduces to the natural numbers and the posi- 
tive fractions. 

The “first combination” and the “second combination”, together 
vvrith the notation 0 and (x) , have now served their purpose of set- 
ting forth precisely in what “addition” and “multiplication” consist 
as applied to fractions. We may, there lore, henceforth discard them, 
and write -j- and X as signs for the processes we have so carefully 
defined; e.g. 

A _ 175 -f 192 _ 367 

12 35 420 420 ’ 

A X ~ = 80 __ A 

12 35 420 21 ‘ 

Between any two numbers, a and b, {a < b) of the present 
system there lies a number of the system. For, the number 

__ a b 
^ “ 2 

has the property that 

a < c < b. 

Hence there is an infinite set of numbers lying between a emd h. 

There is no least number. For, if a be any number, then i a 
also is a number, and ^ a <. a. 

By the distance between a and where a <, b^ shall be meant 
the number b — a. 

If a be any number of the system, then there are numbers 
larger than a and arbitrarily near a\ and also numbers less than a 
and arbitrarily near a, For, let c be chosen arbitrarily small and, 
in particular, let € < a. Then the number a — € is less than a 
and distant only € from a. And, similarly, a -f- € > ^ and distant 
only € from a. 

Finally, if a be a number of the system, however small; and G, 
a number, however large, then a natural number m can be found 
such that 

ma > G. 



For, let 
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(both taken, for definiteness, in reduced form). Then the inequality 
we wdsh to establish is, that 

jnE- >?- 

9 <? ■ 

By definition, this inequality holds if 

mpQ^ > qP, 

Here pQ and qP are natural numbers, and an m can always be 
found to satisfy this condition — e.g. m = 9 P + 1 . 

§3. Negative Numbers. Consider a new logical class, or 
class of elements, {a, b), where a, b are fractions.* Two of these 
numbers,, {a, b) and (<2', Z>'), shall be said to be equal-, 

{a,b) = {a\b^\ 

if 

a b. 

It follows that 

(a + X, + X) = {a^b\ 
where X is any fraction; and also 

(fl-X, b-\)^{a,b\ 

so far as both a — \ and b — X have a meaning. Moreover, these 
are obviously the only numbers equal to {a,b). 

An arbitrary number of the system can evidently be reduced to 
one or the other of the forms («, 1), (1, a). 

Inequality. By definition : 

{a,b) < (fl',6') 
if a b^ <. a^ b. 

Addition. The first combination shall be defined as follows. If 
A ^ [ai, a.2) and B = b^^ then 

A B — (flj "b ^2, a^ "h ^2)* 


* Tl^e component elemexits, a, fr, etc. might eqxially well be' natural num- 
bers; i.e. we can introduce the negative whole numbers in this way before 
proceeding to fractions. On the other hand, we might postpone the intro- 
duction of the negative numbers till the positive irration^s had been defined, 
and then n, h, etc. would be positive irrationals. — The notation ( ) has, of 
course, nothing to do with the ( ) of § 2, which has now been discarded. Let 
the student replace it hf [ ], writing [a, ^], etc., if tliis form is more agree- 
able to him. 
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'fhe Commutative Law, 

A @ B — B @ 

and the Associative I-^aw: 

A®\B®C\^\A®B\®C, 
are seen to hold. 

Subtraction. Let it be required to solve the equation: 

A@X = B. 

Let X — (jTi, x^). Then 

(«i + .^1, ^2 -h x^) = (^1, h^). 

Hence 

“I" + Z>2 ~ ^ + ^^2 4* 

and so 

= ^^2 + />! 

^2 = + ^2 

These equations are both necessary and sufficient. Hence sub- 
traction — defined as the inverse of addition — is always possible and 
unique. The difference, X, is denoted as follows: 

X^BQA. 

The Number 0. The number 

^0 = («. a) 

has the property that 

Aq® A '= A^ A Q) Aq ^ Ay 
where A is any number of the system. It is denoted by 0, or {a, a) = 0. 

The number A^j called the negative of Ay is defined by the 
equation: 

= 0 . 

If ^ = {uy h)y then A* = {by a). 

Furthermore, 

Af =0Q A. 

It thus becomes natural to attach to the sign © a new meaning, 
defining © ^ as the negative of A. Observe that the sign © is now 
used in two senses — once, as a functional symbol in a function of 
two variables. 


/U5) = B©^; 
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and again as a functional symbol in a function ol one variable, 

= QA. 

This explains the meaning of —a in ordinary algebra.* It is 
the negative, of a; the number which, when added to a will 
give 0. But a may be positive, negative, or 0, and —a is not neces- 
sarily a negative number. 

The equation 

A®X =B 

can be solved conveniently by means of A^, the negative of A, For, 
a necessary condition for X is, that 

Af ^ A ® X = Af ® B, 

Hence 

0 © X = ® B, 

or X = © A'. 

Conversely, this condition is sufficient. 

The Law of Signs, To avoid the ambiguity in the use of the 
sign ©, replace © in the second sense by Thus if A^ is the 

negative of A^ we will write: 

Af A, 

Observe that 

&{&A) = A; A®{&B)==AQB; Aei&B) = A^B. 

We find by direct computation that 

e’ U® B) = S' B) = S’ ^ QB. 

e'ueB) = e'^®B; 

0' (0'^eB) = ^05; 

0' {e’AeB) = A@B. 

These identities justify the ordinary rules for the use of the 
minus sign in Algebra. They show clearly the two meaning’: of that 
sign in such transformations as 

— U--Z>4-c)=— —c. 

Here, the first term on the right, —a, is the negative, a', of a. The 
last minus sign is capable of two interpretations: 

• In the lines that follow, our references to ordinary algebra are purely 
for illustrative purposes. The systematic connection with ordinaiy algebra 
will be made at the closer! the paragraph. 
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i) it may be the 0 of 

(— a + t) Gc; 

ii) it may be the 0' ot tlie negative of c, — 0^ the plus 
sign being omitted: 

( — 0 (0' c) — — -h Z? 0' c. 

Multiplication, The second combination is defined as follows. 
li A = {til, 02 ) and B = then 

yl B — {a^ hi d" ^2 ^ 2 ^ ^2 d” ^2 ^i)* 

It is at once obvious that the Commutative Law holds: 

A(E)B = B®A. 

'The Associative Law, 

A (S) B(^C\^] A® R ®C\ 

is also true. For, co npute the left-hand side; it is: 

1^1 ^1 d" III ^2 ^2 d* tfo 0*2 d" ^2 ^2 

hi Co d" ^2 d“ CL'2, d* ^2 ^2 ^ 2 )' 

Next, observe that, on the right, 

\ A®B\®C^C®\B®A\, 

It is, therefore, enough to note that the above expression is unchanged 
when the cCs and the c’s are interchanged. 

Finally, the Distributive Law, 

@ S 5 © c ! = i ^ ® s i © ) @ c I , 

is shown to hold by direct computation. 

The Tdemf actor. The number 

/ = (a -f 1, a) 

has the property that 

A® I ^ A, I® A = A. 

It will be shown presently that it is the only number that has 
this property for all A^s, and that even for a particular ^ 0 it is 
unique. 

This number is, for multiplication, what 0 is for addition: 

A®0 = 0®A=^A. 

Divison. I^et it be required to solve the equation 

A®X = B. 
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If /^ = (ai, ao) be any number ^ 0; i.e. ai ^ ay; tlien there 
exists a number yi' such that 

or A^ ® A = 1. 

We wish, namely, to solve the equation: 

(fll, flTo) ® (-^1» ^ 2 ) = 4* 1, X), 

where X is arbitrary. Thus 

JTi 4- <^2^2 =" X 4- 1, 

^2 + ^1 — X. 

Hence either i): 

t («i — 4) = X (fli — a,) + «! 

^ (af — a|) jTj = X (aj — ao) — ao 

if ai > ^^2 X is so chosen that 

X (^1 •“ ^ 2 ) ^ ^2* 

Or ii): if ai < ^Z 2 i then 

r {a\ — af ) a:i = X (aj — aj) — aj 

X (a| — aj) arj = X (aj — aj) + aj 


X being so chosen that 

X (02 — «i) > «!• 

When, however, = ^2 = c, the equations reduce to 

f CXi + CX2 = X + 1 
V coTi 4- ca :2 = X. 

These equations never admit a solution. 

Returning, now, to the equation 

A ® X ^ By 

assume that A ^ 0. Then a necessary condition for X is, that 
Af®A®X==Af®B 
or I®X = A^®B 


or X = B®A'. 

Conversely, this condition is sufficient. 

Thus division is always possible when A 0, Moreover, it is 
unique. In particular, then, T i» unique. 
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Finally, if the product of two numbers is 0, then one of the 
factors is 0. For, ii B = A ^ 0, then X = 0. 

Relation to the Fractions. The present number system contains 
a sub-class of numbers, namely, the numbers {a + 1, \), which, 
together with the four species, are holoedrically isomorphic with the 
fractions. By this we mean that if we relate 
A ~ {a with ^ 2 , 

and so 

B = {b 1., \) with b; 

then 

@ B = (a + ^ -f 2, 2) 

will correspond to -h ^ and 

A B = {^ab “h 1» 1) 
will correspond to ab. Moreover, if 

A <. B, then a <. b. 

Thus the numbers (a -f I, 1) of this sub-class obey precisely the 
same laws of combination (equality, inequality, the four species) as 
do the fractions, § 2, and we may, then, write interchangeably 
{a -f I, 1) and a, @ and -f , @ and X, etc. 

The remaining numbers of the class, except 0, are the so-called 
“negatives” (see above) of these. For, any such number can be 
written in the form; 

= (1, a 1), 

and its negative, is: 

Af = A = {a ^ 1, 1) = tf, 
or 

^ = 0/ a = - fl. 

Observe that we are herewith defining —a. The number 0 is its 
own negative: —0=0. 

The numbers (a, b) for which a^b are called positive numbers \ 
those for which a <. b, negative numbers. The number 0 is neither 
positive nor negative. 

The numbers of our present system reduce, then, to the fractions, 
a = p/q^ of § 2, which we shall henceforth refer to as the positive 
fractions*^ their negatives, — « = — p/q^ which we shall call the 
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negative fraciions\ and 0. Tiiis number system is called the system 
of the commensurable or rational numbers. 

The absolute value of a positive number or zero is defined as 
the number itseh : 

\ A \ = A ii A = (a, b) and a ^ b. 

The absolute value of a negative number is its negative: 

\ A \ -- A^ = (b, a), if A = ia,b) and a < b. 

Inequalities. The relations of inequality, §1, i), ii), hi), hold 
in the present number system; but iv) and v) lapse. Instead of vi) 
we have, however ; 



if a <h and c > 0, then ac < bc\ 
if a <.b and c < 0, then ac > be. 


§4. Irrational Numbers. The Cut. A nong the numbers 
thus far consuleied — the positive and negative fractions — there is 
no number that can solve the equation: 


For suppose x -- rn/n were a root. Then 



or 

Tti^ — 2 rr. 

Here is a contradiction. For, each prijne factor of the left-hand 
side appears an even number of times, but on the right, 2 appears 
an odd number of times. 

If we consider an arbitrary positive fraction, its square is either 
less than 2 or greater than 2. In the first case, we put it into the 
class of numbers wliose elements we denote by ai\ in the second 
case we put it into the class of numbers wiiose elements we denote 
by 6eo. Thus we have a partition of all the positive fractions into 
two classes, and each ai is less than any r/o: 

ai < flo* 

Such a partition Dedekind called a cut. More generally, let any 
criterion be given whereby the commensurable numbers fall into two 
classes, an arbitrary number of the first cUss being less than any 
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number /lo of the second class. For example, every fraction, a, has 
the property that any other fraction is either less than a, and so 
belongs in the class of the ai, or is greater than a, and so belongs 
in the class of the a^. The number a itself may be assigned to 
either class. But the class of cuts is more ccanprehensive than 
the class of the commensurable numbers. There will be in general 
no largest ai nor smallest a^. 

Dedekind considered the logical class consisting of all cuts. This 
is the class of the irrational numbers. Let the mark 

{ai, a^) 

refer to such a cut. It — the mark — shall be called a number^ and 
it may also be denoted by a single letter, as 

A ~ (^ri,^2)- 

Here, the mark A is the number. 

Equality and Inequality. Two numbers, A = {ai,a 2 ) and B = 
(^i,Z> 2 ), are defined as equal: 

A^B, 

if h = 

no matter how ai, ao, ^2 chosen from their respective classes. 
At most one of the lower signs can hold. 

We say, 

A <. B or B "> A 

if it be possible to find a particular hi — b[ and a particular Oo = 
such that 

ag < . 

Rational Numbers. Those numbers {ay, a^) for which there is 
a largest Ui (call it a) or a smallest a^ (call it a) =hall be identified 
with the rational numbers: {ai^a^ a. 

Those numbers (^|, for which some ai is positive are called 
positive numbers., those for which an is negative, negative numbers. 
The number (— ^, — ^ 1 ) is the negative of (^i,zz 2 )» ^ind is writ- 
ten — ■ {ui, a^. The number 0 is neither positive nor negative. 

By the absolute value of (^i, is meant the number itself, 
when it is positive or 0; its negative, when {ai,a2)<.0. It is 
denoted by the symbol: 

M 1 = I (aj, ai) I . 
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§ 5. The Theorem of Continuity. The present number 
system has the property which Dedekind characterized as continuity. 
It is embodied in the following 

Theokkm. Let be a set of numbers such that 

i) 

ii) ^7* = A, 

Then there exists a number U such that 

a) Sn ^ U, n = 1, 2, - • • ; 

b) y < 5n, m ^ n, 

where y is any number less than U : 

y < u, 

and m is a corresponding integer, 

•Proof. Let be a fraction exceeded by some Sn (and so by all 
later ones). Qjnsider the totality of such fractions. Let a<^ be any 
one of the remaining fractions. Then the number 

U = {ai,a^) 

has the properties a) and b). For, first, if V did not satisfy Condi- 
tion a), there would be a number 

^ U , 

and between Sn> and T/, a fraction c: 

LI c Silt . 

Because c <. Snf , c is an ai. This is impossible because every 
ai ^ U. 

Secondly, if Condition b) is not fulfilled, then 

Sn ^ y 

for all values of n. Choose a fraction, c, between y and U\ 

y < c < U. 

Then Sn < c, and hence c is an 02- This is impossible because 
every Oo U. The proof is now complete. 

Decimal Fractions. Let M be any integer — positive, negative, 
or 0 — and let n 2 » * * * = 9) be any set of whole num- 

bers proceeding according to a definite law. Then the mark 

Af . ^2 ’ • * * 
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which is understood as an abbreviation ior the mark-. 


10 lO-* 


is know as a decimal fraction. Thus 3.1415926 - is a decimal 
fraction. If we set 


Sn- M 


10 


+ ••• + 


10'^ 


and identify this number with the Sn of l^edekind’s Theorem, the 
lyaliie of the decimal is defined as the corresponding number, U. 

Conversely, to an arbitrary number A corresponds a decimal 
fraction whose value is A. For, let M be the largest integer which 
is less than A, Choose so that 


.w + f'<^, 


,w + SL^, 


and so on. 


§ 6, Convergence. Limits. The Fundamental Theorem.* 

By the neighborhood of a point A = (uj, U 2 ) are meant the numbers x, 


yi < < 72 1 


where yi < A and y 2 > A are arbitrary. By the ^-neighborhood of 
A is meant the neighborhood, where € is a positive fraction and 


yi = (^1 — U2 — €), 72 = (^1 + €, ^2 + €). 


Let Ml, AL, • • • be a succession of point sets** having the follow- 
ing property. To a positive fraction € chosen at pleasure there 
corresponds an integer m and a point 4^ of Mm such that the 


* It may seem an error of judgment, in these Lectures, to introdiice at 
this point a theorem which, in the scientific development of the student, 
clearly belongs in the chapter on Point Sets. Still, scientific perspective may 
on occasion become more important than the principles of pedagogy, and the 
fact that this theorem is more fundamental than even the Four Species for 
irrational numbers entitles it to rank tliese processes. The beginner will do 
well to read this theorem and its proof with an open mind, but not, at this 
Stage, to give it more thought than his imagination readily supplies. He can 
come back to it after finishing the chapter on Point Sets, but he should think 
of its place in the science as here, rather than later. 

♦*cf. Chap. Ill, §1. It is merely the conception or deHnition of a point 
set with which we are here concerned. 
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€ -neighborhood of contains the set if// ^ m. Tlie point 

sets Mn are then said to converge as u — oo. 

Theorem 1. Let Mi, Mo,* • • be a convergent sequence of point 
sets. Then there exists a number U such that an arbitrary ^'neigh- 
borhood of U contains all the later Mn (a ^ m). 

Proof. Let Ui be a fraction that is exceeded bv some point of 
Mn for all values of n from a definite point on; i. e. for n'^m, 
where m depends on Ui, Consider the totaliiv of such fractions Ui. 
Let ^2 ftaotion not an a^. Then the ai, define a cut: 

n = iai,a.f. 

This number U has the properties of the U of the theorenn For, 
let be a positive fraction < ^ e, and let p., be the numbers m, 
5m corresponding to by the hypothesis of convergence. Then Mn 
lies in the € '-neighborhood of 5 'j. when n ^ fL. But the points of 
this neighborhood lie in the € -neighborhood of U. E’or if it extended 
above the -latter, there would be fractions ai'> U\ and if it extended 
below the latter, there would be fractions < U. 

Definition, of a Limit. The number U is defined as the limit 
of the numbers x constituting M„ , as n becomes infinite. 

Theorem 2. Let Mi, Mo, • • • be a convergent sequence of point 
sets, and let Ni, -Vo, • * • a second sequence, the points of Nn 
being all contained in Mn. Then the second sequence converges and 
has the same limit as the first. 

In the foregoing definitions and theorems the point sets M„ have 
been made to depend on a single integer, n. It is obvious that they 
may equally well depend on variables which in a more general sense 
approach limits; cf. the definition of Function in Chap. Ill, § 5. It 
is enough for our present purposes to consider a single extension, 
namely, to an aggregate of point sets Mnq, where n and q are natural 
numbers, and where the earlier condition m = tz is now replaced by 
the pair : m ^ n, I ^ q. 

§7. Addition of Irrationals. The sum# of two numbers, 
A = («i, ^ 2 ) ^ ~ shall be defined as the number C — 

(q, Co): 

A B = C, 


• We now drop the expression '‘first combination”, meaning by “sum” 
the same thing. 
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where 

Cl — Cl\ ^2 — ^2 “h ^2i 

or 

(«1, flo) 4 - (/>!, ^2) — (^1 + hi, flo + ^2)* 

Tt is understood that each ai is combined with each hi to yield the 
Cl ; and similarl}: tor C 2 . 

Fo justify this delinition observe first that 

Cl <C C 2 , 

since 

CLl ^2* ^2* 

Secondly, to an arbitrary positive fraction, €, there correspond 
a c\ and a cl «uch that 

Co ^ Cl ^ , 

b'or, to an arbitrary €' > 0 there correspond the relations; 

CI 2 -f- €, ho 

Hence 

^2 d" ^2 ^ T “h 2 
and it remains only to set 

^ , Cj = T Z>j , C 2 = ^2 d" ^2 • 

f’inally, the Cj, C 2 exhaust all the fractions with possibly one exception. 

Addition obeys the Commutative Law: 

I . 

and also the Associative Law: 
n. A ^ {B C) = {A B) C. 

It is obvious that 

A A 0 ~ A, Q A A ^ A, 
wliere A is any number. 

Subtraction, The inverse af addition is subtraction. The pro- 
blein is to solve the equation: 

A A X H. 
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Consider first the case B = 0, It is obvious that one solution is: 


= (— ao, — flfi). 

Thus 

J ^ = 0. 

Ijet be an arbitrary solution: 

A A" = 0. 

Then 

A' A A" -= A\ 

and since 

A' + A = 0, 

it follows that 

= Af. 

Hence A^ is unique. 

Proceeding now to the general case we find as a necessary con- 
dition : 

Af + A X = Af B, 


X = B + Af. 

Thus X can be no other number; and we see that, conversely, this 
number is a solution. Hence subtraction is always possible and 
unique. 

Observe the inequalities: 


i) 

U + 5| S \A\ 

+ |B1, 

ii) 


\A + B 

iii) If 

\A-X\ ^ 

H, 

then 

1 

IIA 

IIA 

A + H, 

and conversely. 




§8. Limit of the Sum of Two Variables. Let Mi, Mo, - • • 

and iV|, No, • - • be two convergent sequences of point sets. Let X 
be a point of Mn and Y a point of Nn^ Form the sequence of 
point sets Pi, P 2 , where Pn consists of the points A + T. 

Then Pn converges, and 


lim Pn = lim Mn + lim Nn, 

n=^ n=oo n==co 


or 


lim (X' + T) = lim X + lim Y. 
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We wish to show that, to an arbitrary* € > 0, there cx)T~ 
res|)onds an rn such that 

\IJ + V - X - Y\ < m ^ n, 

where X and Y are points of Nn^ and m ^ n. 

W^e know that, to any c' > 0, there corresponds an m such that 

\rj-x\< €', \r~Y\< €', 

where X, Y are points of Mn, Nn. and m = ?i. Hence 

I ^7 + r - X - r| < 2 €'. 

If, then, we choose c' = ^ €, the proof is complete. 

W^e could equally well have defined an aggregate of point sets 
Pn(f made up of the points X of Mn and Y of and shown in a 
similar manner that 

lim PtK/ — lim Mn + Hrn JSfq . 

(n, ^ =^oc, oc') r:=co 

§9. Multiplication of Irrationals. The product of two real 
numbers, A = («i, ao) and B — (^x, hy), shall be defined as follows. 
1 Ait fractions be chosen at pleasure : 

€i ^ €0 ^ lim €„ = 0; 

n=oo 

^ ?j 2 S % lim fjn = 0. 

n=oo 

I^t Up {p = 2) be any point of the €„-neighborhood of A, § 6, 
and let bp = 1, 2) be any point of the T^y,-neighborhood of B. 
lot j X ! = Mn consist of the points 

X = ap bq. 

Then these points approach a limit, 

V = («i, Uo), 

as n becomes infinite. This number is defined as the product of A 
and B : 

U = AB, 

(«i» ^2) (^i» ^2) = li'ia \ apbq\. 


• Now that addition has been defined it is obviously henceforth immaterial 
whether we require £ to be a positive fraction or an arbitrary positive 
number. , 
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For, lot aphff lie in and let a'pt, hqt, lie in any 

m ^ and so, also, in Mm. 

Since 

I apt ^p\ ^ I btjf — ^ 2 1]^ , 

it follows that 

apt = Up I Cl I < 2 (.m, 

biff = bq -+" C 2 * I C 2 1 2 1]rn* 

Hence 

Up! btjr apbq = bq Cl “h C 2 "h Cl ^ 2 * 

Now, there is a constant G such that 

\ap\ < G, \bq\ < G 

for any ap, bq under consideration. Consequently 

I a'pr bqt — apbq \ <. (r (2 C/n + 2 x^rr^ + 4 €m 
If, now, a positive fraction € be chosen at pleasure, m can be so 
determined that 

Cr (2 €m + 2 Ijm) + 4 €.m < €. 

Consequently the €- neighborhood of a point C of Mm — namely, 
C — apbq — contains all the points of each later Mn (m < n) and 
so the sequence of point sets Mn converges. 

Idemf actor. There is one number of the system, namely : 

I — (^i, a2'), ^1 = 1 <C fl2» 

which has the property that 

IJ := AT = d, 

where A is any number of the system; and I is unique, as will 
appear from the uniqueness of division. T is the number 1. 

The truth of the Commutative Lawi 
I. AB = BA, 

is obvious from the definition. The Associative Latv: 
n. {AB)C = A{BC\ 

is also true. For, let fractions 

X„ ^ X„+i , lim Xn = 0, 

n==co 

be chosen arbitra.rily, and let Cr (r = 1, 2) be a point of the Xn* 
neighborhood of C = (ci, Cg). Let M^ consist of the points 
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OC — CLp l?q Cf‘ . 

'Fhen it is shown exactly as before that these points x approach a 
limit, 

lim { Up hq Cr j • 

n~oo 

This number, F, has the value UC, where U — AB. For, the 
definition of the latter product is as follows. Let U ~ (w], Uo)- Let 
fractions 

^ . lini fLn = 0, 

n~oo 

be chosen, and let iA:, {tt = 2) he a fraction lying in the 

neighborhood of IJ. Let Cr, as before, lie in the X„-neighborhood 
of C. Then Nn shall consist of the points and 

U C = lim \ Utz Cr \ ‘ 

n—oo 

Since the points ap bq for a given n include all the fractions 
lying in a certain neighborhood of the point U ^ A B, it is clear 
that the fj^n can be so chosen that the /i^-neighborhood of U will 
include only such fractions as are contained among the above 
ap bq. When this is done, the points of the set \ Cr i for a given 
n are all contained among the points of the set \ Up bq Cr } correspond- 
ing to the same n. Thus the j Cr } are sub-sets of the j Upbq Cr I* 
and hence, by Theorem 2 of § 6, their limits are equal, or : 

V = UC = {AB) C. 

On the other hand, F is invariant of the order of the factors, 
apy bq, Cr- Hence 

F= {BO A, 

and since the commutative law holds, 

F^A{B C). 

Thus the Associative Law is established. 

Division is the inverse of multiplication and is expressed by the 
equation : 

AX = A 0. 

First, let B = I, the idemfactor, / = 1 : 


1 . 
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One solution of this equation is the following. T^et a set of fractions 
be chosen : 

€i ^ €2 ^ •**, lim = 0, 

n=oo 


and let Cj < \ 4 \ . Let A = a^), and let Mn be the points 

\/ap (/?=!, 2) where ap lies in the €„-neighborhood of A. Then 
the sequence of point sets A/o, ' • • converges. For, let Up, aq 
be any two points of and let G be a positive fraction <C \ A \ — ^x. 
Then 


1 1 Clq Qp 

dp CL q Clp dq. 

and hence 

_L _ _L _ ^ 2i„ 

ap a'q I apo!/ | (J2 

Denote the limit by A^ : 

A A' = A' A = 1 . 

It is called the reciprocal of A, and is unique. For if 

AA^' = 1, 

then A'AA'^ == A\ 

or A" = A', 

Turning now to the general equation, 

AX^B, 

multiply by A^: 

A'AX = A' 

X = BA^. 

Thus division is always possible when 4^0, Moreover, it is 
unique. For, if 

AX = AY, 


then A' A X = A' A 7, 

and so X = Y. 


Multiplication has been defined and the foregoing properties have 
been established, independently of addition — in fact, the whole treat- 
ment could precede addition. We turn now to the last of the five 
formal laws, which combines both addition and multiplbjafion. 
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The Distributive Law: 

A{B ■^C) = AB + AC. 

Here, if A — {ai, ^ ^ 2)1 C* = (q, Co), the left-hand 

side is, by definition : 

A{B C) — lim { Up {bq + Cq) j. 

n—so 

On the right, 

A B ^ lim j Up bq j, A C ~ lim \ apt Cqr | . 

/J=30 72=00 

By the theorem of § 7 and Theorem 2, § 6 the first of these 
three limits is equal to the sum of the last two, and this proves the 
theorem. Thus the five formal laws of algebra hold for irrationals. 

The System of Real Numbers. By this is meant the class of 
numbers defined above as cuts, plus the four species defined for these 
numbers. This number system has the property that a product 
vanishes when and only when one of the factors vanishes. 

§ 10. Roots. Inequalities* From the definition of a number 
as a cut follows at once that the equation 

= a, 0 = fl, 

admits one and only one positive root (or 0) : 



For, let ^2 ^ smy positive fraction such that 
a < a^, 

and let ai be any other fraction. Then 

X = {ai, a^) 

is a solution of the equation, and the only solution which is not 
negative. 

Inequalities. Any two numbers of the system of real numbers 
are equal or unequal, and if a <, Z?, then b "> a. Moreover, if 
a <, b and b <. then a c. Between any two numbers, a <. b., 
lies a number, c: a <, c <. b. Also, if 0 <C a and 0 <, b, there 
is a natural number n such that na > b. 

Tlie student will find it convenient to have firmly in mind the 
further relations : — 
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i) \i a <. h and c ^ then a c <, b d. 

ii) It 0 = « < and 0 = c < then ac < hd, 

r ka < kb, if 0 < A* ; 

iii) II a <, b, then < 

C ka > kb, if A < 0. 

iv) If 0 = < b, then 

^ a <1 \/ b and a” <1 A”. 

v) \ a b\ ^ \ a \ \ b\, 

vi) 1 ! 1 (I 1 — I 3 I i I = I « + ^» I- 

vii) If 1 a — .r 1 ~ h, then 

a — h ^ X ^ a h, 

and conversely. 

§ 11. Retrospect. Starting with the natural numbers and the 
four species, we proceeded to the positive fractions, and thence to the 
negative fractions, thus obtaining the system of rational numbers. 

From this point we introduced the irrational numbers by means 
of the cut. The definitions of equality and inequality, and of addi- 
tion, were most natural and simple. Even before addition was de- 
fined, it was possible to formulate and prove the fundamental theorem 
concerning limits, and thus the basis for all analysis occupies the 
first place in the development of arithmetic. Multiplication derives 
its definition from this principle. 

On the other hand one might reasonably seek to create the 
number system first. Addition is defined naturally by means of the 
definition of number as a cut : 

(fli, + (A|, b^ ~ {ui -F bi, -F &2)‘ 

One would like to define multiplication in the same manner : 

(fli, {bi, Ao) = {ai bi, a^b^. 

But this is impossible when we start with the system of (positive and 
negative) rational numbers, since the fractions ai b^ and ^2 
not define a cut. 

There is a way cut. Introduce the irrational numbers after the 
fractions; i. e. before the negative numbers have been defined. Then 
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the above definition of multiplication is valid. We thus obtain the 
system of positive real numbers. The negative numbers can now 
be defined precisely as before, and we arrive at the system of real 
numbers. 

What have we lost by this method? Nothing of a logical nature; 
nothing of simplicity in the small. But in the large 'there is a lack 
of unity in the definition of the real numbers. There was no lack 
of unity in the definition of the system of rational numbers (positive 
and negative fractions, and 0). And there is no lack of unity when 
we advance from these to the real numbers by the cut. There is no 
lack of unity when we introduce the fundamental principle of limits 
even before the definition of addition. And from here on the devel- 
opment leaves nothing to be desired in point of simplicity. 

All this has, however, an apologetic sound. Our views are ex- 
pressed in negatives. It is important to make clear the positive rea- 
sons which justify the course we have followed. These are : 

I. The Cut. The phenomenon of the partition of all the 
numbers of the system before us into two classes, the ai and the 
with . 


appears again and again in the most elementary and important con- 
siderations one meets in practice. It is natural, then, to seize on 
this mathematical manifestation as the defining element in extending 
the number system to its final scope. In Physics, that definition is 
best which lies closest to the heart of the phenomena to be analyzed, 
and this principle has its counterpart in Mathematics. 

n. Limits. The prime object of extending the number system 
is continuity and the existence of a limit. If it were not for these 
phenomena, we could get on very well with the system of rational 
numbers (positive and negative fractions, and 0). Since the notion 
of the limit is the cause for generalizing arithmetic, its place is 
naturally the earliest possible one — immediately after the definition of 
the new numbers. From the point of view of scientific perspective, 
then, this arrangement leaves nothing to be desired. 

So we need make no apology to the beginner for leading him 
over a path that is hard for his tender feet. He is being trained in 
the most important methods of the science, and his efforts will be 
rewarded by the acquisition of insight and power in analysis. 
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The Method of Regidar Sequences. It is possible to introduce 
irrationals by a method which is, perhaps, more convenient for the 
beginner. Suppose we have established the system of rational numbers. 
By a regular sequence is meant a set of these numbers, 

• • • having the property that, if € be a positive fraction chosen 
at pleasure, there corresponds an integer m such that 

I I m n\ 

The regular sequence is now made the element of a new logical 
class, the real numbers. If, in particular, there is a rational number, 
a, such that, to an arbitrary positive fraction c corresponds an integer 
m, for which 

! zz — I < € , rn 

this regular sequence is identified with a\ i.e. set equal by defini* 
tion to a. If not, a new number is introduced. In either case, 
the element of the logical class is the mark which consists in the 
regular sequence. 

Two regular sequences, * ‘ *) B = (&i, ’ * *)♦ 

are defined 8 ls equal if to an arbitrary positive fraction € corresponds 
a natural number m such that 

[on — bn\ < ^, m ^ n. 

The number A is defined as less than B, 

A < B, 

if there are a natural number m and a positive fraction h such that 

h < bn, m^n. 

By the sum of two numbers, 

C = ^ + 5, 

is meant the regular sequence 

C = (zzi + bi, ^2 + ^2» • * * )• 

Subtraction is always possible and unique : 

A B ^ (zzj ““ b\, 02 * * * )• 
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The product of two numbers, 

is defined as the regular sequence 

C — h^j {to * * * )• 

Division by any number but 0 is always possible and unique : 

^ am+l . . 1 

B ^ hm ^m+1 ■* • 

The justification for each of these definitions; i.e. the requisite 
convergence proof, is simple. 

Thus the System of Real Numbers — the definition of irrationals 
and the extension of the four species to the new numbers — is 
established. The method has the advantage of simplicity in detail. It 
is well for the student, after a first study of the method of Dedekind, 
to work it through in all detail. He will then return to the former 
method with increased power and greater zest. 

The method of regular sequences is a middle-of-the-road method. 
It is an easy way to reach the mountain top. The traveller buys his 
ticket and takes the funicular. Many people prefer this mode of 
travel. But some like a stiff climb over rocks and across streams, and 
such an ascent has its advantages if the heart is good and the muscles 
are strong. 



Chapter III 

Point Sets. Limits. Continuity 

§ 1. Definitions. By point is meant the expression (.I’l,* • 

The numbers are called its coordinates. A point in space ot 
n dimensions may be thought of as corresponding to it. But this 
idea is introduced merely for the convenience of geometric intuition, 
— not as an essential part of the concept. Any collection of points, 
defined so as to be recognizable, is called a point set. Each point is 
called an element of the set. 

Examples. When n = 1: 

a) The proper fractions. 

b) The continuum a < x < b. 

c) The line segment a ^ x ^ h. 

d) The incommensurable numbers between 0 and 1. 

e) The natural numbers. 

f) Their reciprocals, 1, J, J, * * • • 

g) The numbers 1, i, J, * • * and 0. 

h) The positive numbers. 

i) All the real numbers. 

j) A finite set of points, like 0, 1. 

When 71 > 1: 

k) The open square, when n = 2 : 

-1 < :r < 1, -1 < j < 1. 

l) The closed square, when n = 2: 

^ X S U -1 ^ 7 ^ 1. 

m) The rational points of space : (xi, • * * , Xn)^ where the xk^s 
are all fractions. 

n) The surface of the unit (hyper-) sphere : 

aq + *1 + • • • + xl= i. 

o) The interior of the unit (hyper-) sphere: 

-p jrl -t- • • • + < 1- 

Distance. By the distame between the points (rti, • • • , Oy,^ and 
. W is meant the number : 

D — V\ai — («n — 
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Bounded, A point set is bounded if the distances of its points 
from a fixed point are all less than some fixed number. 

Finite, A finite point set is one consisting of a finite number 
of points. 

Open Set. If to an arbitrary point • • • , ^Zn) of the set there 
corresponds a positive number dependent in general on (zr), such 
that all points fri, • • • , :r„) for which 

aj^ — h <. xj^ <, aj^ A: = 1, • • • , n, 

belong to the set, the set is called an open set. 

Neighborhood. By the neighborhood of a point is meant a con- 
nected open set including the given point. It is usually a simple 
region, like a square or a circle with the point as its centre. 

Cluster Point. A point A is called a cluster point or point of 
condensation of a set if an arbitrary neighborhood of no matter 
how restricted, contains points of the set distinct from A. 

Isolated^ Discrete. A point ^4 of a set is called isolated if 
within a suitably chosen neighborhood of A there are no other points 
of the set. A point set is said to be discrete if all its points are 
isolated; cf. Examples e), f), j). 

Boundary Point. A boundary point of a set is a point in every 
neighborhood of which there is a point of the set and also a point 
not belonging to the set. The point itself may or may not belong 
to the set. 

Closed Set. A set is closed if it is bounded amd contains all 
its boundary points. 

Standard Element. By this is meaut the point set (xi, • • • , Xn), 
where 

^ hkj A: =!,•••, 72. 

The point (zzi,- • *, zz„) is called the centre. The boundary points of 
a standard element are those points (jyi,* * *, yrd for which 

aj, — hki Yk ^ hk, ^ = L* * S n, 

at least one lower sign holding. The closed set consisting of a stand- 
ard element and all its boundary points shall be called a standard box. 

Connected, An open set, Af, is said to be connected if it has 
the following property. Let A and B be any two of ^its points. Then 
there shall exist /i + 1 points of the set, Pq = *4, Pj,* • *, Pn-i » 
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Pn^B^ and n standard elements, Rq, Ri, •••, where the 

centre of Rj^ is Pj^ and Rj^ lies in M, such that Rj^ contains 
k = 0, 1, • • •, n — 1. 

Dense. A point set is everywhere dense in an open set if each 
point of the latter is a cluster point of the former. It is intrinsically 
dense if .each of its points is a cluster point. 

Perfect. A set is perfect if it is closed and intrinsically dense. 
A closed interval, a S x ^ b, \s dxi example of a perfect set. But 
a perfect set does not necesssurily contain any open set whatever; 
cf. § 2. 

Linear Point Sets 

tipper Bound. Upper Limit. A linear point set, i. e. a set for 
which n = 1 , is said to have an upper hound if there is a fixed 
number A such that 

X ^ A, 

where x is any point of the set. Any larger number, J5 > ^, is 
also an upper bound of the set* 

If A belongs to the set, or if there are points of the set in 
every neighborhood of A^ then A is the upper limit (or least upper 
hound) of the set. 

When the upper limit is a point of the set, it is called the 
maximum. 

For example, the number 2 is an upper bound of the proper 
fractions. The number 1 is their upper limit. But the set hats no 
maximum. 

It is obvious how lower bounds lower limit or greatest lower 
hounds and minimum should be defined. 

Tueohi.m 1. A linear point set which has an upper hounds 
has an upper limit. 

Let be a fraction, to the right of which lies a point of the 
set. Consider the totality of such fractions. Let a^ be any fraction 
not an a^. Then these two classes of fractions define a cut, {a^^ 
and thus determine a point, U = (aj, ^ 2 )- point is the upper 

limit of the given point set. For, 

i) it is an upper Sound. Suppose there were a point J of the 
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set, s ich that ^ U, Then there would be a fraction, a, between 
U and 

// < a < £, 

This fraction would by definition be an aii 

a = ai. 

Thus we have the contradiction of an > U. 

ii) U is the least upper bound. For, suppose A <. U were an 
upper bound. Then there would be a fraction 0 between A and U : 

A < ^ < U, 

But 0 would by definition be an tLi, and so we should have the con- 
tradiction of an ^2 ^ U, 

Similarly, a linear point set which has a lower bound, has a 
lower limit. 

By a finite interval is meant a point set 
a <. X <. by 


to which may be added one or both of the end points. 

Theorkm 2. The Weihhstrass-Boi.zano Theotikm. An in^ 
finite linear point set which lies in a finite interval^ has at least 
one cluster point. 

Consider the points x of the line, such that, if x^ be any one 
of them, only a finite number of points of the given set (in particular, 
none whatever) lie to the left of x. This point set is bounded from 
above. It has, therefore, an upper limit, G. This point, G, is a 
point of condensation. For otherwise it would be an isolated point 
of the set, or not belong to the set at aU. In either case, there 
would be a point x to the right of G. 

The theorem is true for a point set in space of n dimensions. 
It can be proved conveniently by means of the Covering Theorem, § 11. 

§ 2. An Example. Consider the interval 0 ^ x ^ 1. From 
it we proceed to remove 


certain points. The point 
set we thus construct con- 



sists of the points that remain. 


k t 
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Step 1. From the middle of the interval remove the points of 
an interval of length 

!.=X-lx, 

where 0 < X ^ 1 is a constant chosen once for all. More precisely, 

the points removed are those for which 

11, 11 
““ l\ X "1“ Zi , 

2 2 2 2 

Step 2. From the middle of each of the remaining intervals 
remove an interval whose length, is such that 


h + 2/o 


X ^-X 

4 


More precisely, the points removed are those for which 
a — ~ I 2 < X < + 


where a denotes successively the mid-point of each interval remaining 
after the first step. 

n-th Step. From the middle of each of the intervals remaining 
after the (n — l)-st step remove an interval of length where 

A + 2 Z, + 2^4 + • • • + 2 ” > Z„ = X — X. 

n + 2 

Those points which remain, no matter how large n be taken, 
constitute the set we undertook to construct. 

The set is perfect, for it is closed, and each of its points is a 
cluster point. It is, however, dense in no interval, for an arbitrary 
interval contains intervals which have been removed. 

The sum of the intervals removed up to the {n + l)-st step 
approaches a limit, namely, X, as n increases. 

The points of the set can be enclosed in a finite set of intervals, 
the sum of whose lengths, however, will exceed the value 1 — X. 
If X == 1, this sum can be made arbitrarily small. But if X < 1, 
this is not the case. 

Curiously enough, the points of tlie set admit a simple arith- 
metic expression when X = 1. They are the numbers 


= 0. aj a2 0.3 


, ^2 ■ ^3 , 

3 32 53 ‘ ' 
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expressed in the triadic system, where the a’s take on at pleeisure 
the values 0, 2. 

Incidentally, these points can be transformed on the points of the 
closed interval, but not in a one-to-one manner. Let 



and consider the number y expressed in the diadic system as 
•y = 0. 01 Pa 03 • • • = ^ + ^ + ^ + • • • • 

It is obvious that every number y of the interval 

0 ^ y ^ 1 

is thus obtained at least once, but some points are obtained twice. 
Thus we have a transformation of the points of a closed interval on 
the points of a perfect set which is nowhere dense in any interval 
some points of the former set even going over into two points of the 
latter. 

§3, Functions. Let an arbitrary point set M in space of n 
dimensions be given. Let (ri, • • •, Xn) be any one of its points, P. 
Let a number y be assigned to P by any law whatever. Then y is 
called a function of P : 

Represent as a point of the linear manifold, iVj. Then the 
law whereby the function is defined establishes a transformation^ of 
the points of M on the points of Ni, This transformation can be 
represented by the aid of the surface (i.e. hypersurface, manifold), 
defined by 1) in space of n + 1 dimensions. Call it 53. In the 
simplest case, tz = 1, 53 is a curve, provided that /Vf is an interval. 
But it is not this manifold apart that expresses the idea of the func- 
tion. It is only when we relate it to the manifold M and think of 
it as the collection of points which have gone out of M by the 

given transformation, that we reproduce the entire conception of the 

function. Thus when n = 1 we may draw the picture of the set 

of vectors parallel to the jy-axis, the initial point lying in (x, 0) and 

• Caratheodory begins his account of the conception of a function with die 
words: Der moderne Begriff einer Funhtion deckt sich mit dem finer Zucrdnung. 
Cf. his VcrUswigen uber reelle Funktionen, p. 71, § 83. 
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the terminal point in (x^ y). This manifold of vectors, localized as 
stated, does give a complete account 
of the conception of the function. 

The locus of their terminal points is 
the manifold 2]. But S by itself 
does not yield the conception of the 
function. It is only when we think 
of S as defining the set of vectors, 
that we arrive at the basal idea of 
fimction. 

On the other hand, since the manifold S does determine uniquely 
the set of vectors, it yields a means of defining or representing the 
function. The function is the set of vectors. The manifold S stands 
in a one-to-one relation to the ccwicept : function, and for many pur- 
poses can be used to represent the function, with the consciousness 
of the vectors. 

We have spoken only of the case of single-valued functions. The 
extension to multiple- valued functions is obvious. 

At the beginning, we spoke of jy as the function. Thus we 
should say: The value of the function 

y = 

when = 1, is 2. This is a different meaning of the term. Both 
meanings exist side by side in common parlance, but no confusion of 
idesLS arises from these two uses of the word. 

§4. Continuation. In the last paragraph we thought of the 
domain of definition of the function as a point set; and we trans- 
formed each point P of the set on a point y of the linear manifold. 
We may express this idea trenchantly by saying : r is a point func- 
tion, and write: 

1 ) r=f{py 

We may generalize this idea by beginning with a set of mani- 
folds, For example, we might take an arc of a curve, like- an arc 
of a circle, or an arc of a continuous curve that has no tangent 
(Chap. IV, § 2) or an arc of a simple Jordan curve (Chap. VII, § 10) 
and then inscribe a broken line. These broken lines would serve as 
an illustration of such a set of manifolds as we have in mind We 
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might attach to each element (i. e. each broken line of the set) a 
number, namely, its length, y. Thus a transformation of the ele- 
ments of this set of manifolds on the points of a linear manifold 
would be defined, cUid this transformation gives us an extended idea 
of the concept Junction, If we let M refer lo any one of the broken 
lines, we could write suggestively 

2) r =/(M), 

and call r a function of M. 

Again, consider an arbitrary bounded point set S in the plane. 
Let M be a polygon, or a number of polygons, each set M contain- 
ing the points of S in its interior, and each member of a given set 
M being bounded by lines parallel to the axes. More precisely, these 
lines shall be chosen from the lines 



where n is a. natural number and /?, g are whole numbers. To each 
of these sets M we could attach ihe number y which represents its 
total area*, and thus each M would be transformed on a point of a 
linear point set. This transformation may be taken as an example of 
the extended concept function. 

Another example is given by removing the requirement that the 
sides of the polygons lie along the lines 3), and allowing them to be 
any parallels to the axes. 

These examples illustrate the generalization of the concept June- 
tion^ which we will now formulate as follows. Consider a collection 
of point sets A, Each A may be any point set one pleases to define 
in space of n dimensions. The totality of these A*s shall be referred 
to as the manifold, ?l, of the A\, To each A shall be attached a 
number, y. Thus the elements A oi U are transformed on the points 

* For purposes of illustration we could also take as ^ the total perimeter, 
or the sum of all the diagonals. 

On the other hand, S might be an arbitrary manifold in space, and Af, a 
polyhedron containing S; its sides, or faces, lying in the planes: 

p q r 

X ^ , T — n * S® • 

2n’ •'2" 2” 

The extension to space of any number of dimensions is now obvioiu. 
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of a line. This transformation is a concept which we denote as a 
function. We write: 

r =/(.^), 

and say that ^ is a function of A. The manifold SI is the domain 
of the independent variable, A\ or the domain of definition of the 
function. 

A third extension of the concept function is the following. We 
start, as in the last case, with a manifold ST of point sets A, and 
now we assign to each A a point set B according to any law what- 
ever. Denote the manifold of the 5 by S3. Then this transformation 

of Sf on S3 through A > B shall adso define the concept function. 

Thus in polar reciprocation a plane determines a point. 

§ 5. Limits. We begin with the simplest case of a function, 

I) y =/W. 

defined in the points a: of a linear set A. I^t a be a cluster point 
of A. 

By the 8 ’■neighborhood of the point a we mean the point set 
{8)a: a — 8 < X <, a + 8y 

or, what is the same thing, the points x for which 

\ X — a \ < 8. 

By the abridged 8 -neighborhood of a we mean the point set 
{8)a obtained from {8)a by removing the point a\ i. e. the point set 

(<r)i: 0 < I < <y. 

Definition. The function fix) shall be said to approach a 
limit when x approaches ^ if to an arbitrary positive 6 there corre- 
sponds a 8 such that 

\f{x') -fix") 1 < £. 

where x', x^^ are any two points of {8)^ which lie in A. 

According to the theorem of Chap. II, § 6 there then exists a 
number b such that, to an arbitrary € -neighborhood of b, 

i^)b- \y-b \ < e, 

there corresponds an abridged <y -neighborhood of a, (^)ai with the 
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property that the value y of the function for an arbitrary x oi A 
lying in {S)^ is a point of (e)^, or: 

1 [ < €, 0 < 1 j: — I < 

where x lies in A, 

Conversely, if f (x) has the latter property, then it approaches a 
limit. 

The number b is called the limits and we write : 

2) lim fix) = b. 

x=a 

Relgtion to the Earlier Definition. The relation of the present 
definition of a function's approaching a limit to the earlier defini- 
tion of the limit of a point set is as follows. Here, we start with 
a variable point set, namely, the points j :r | of A which lie in the 

abridged ^ -neighborhood of a, i.e. in {S)a. This point set, 

approaches a limit, namely, as S approaches 0, by the definition 
of Chap. II, § 6. 

By means of the function 1) this point set \ x \ is transformed 
into a point set jyj, depending on 8. And now the function 1) is 
said to approach a limit if this latter point set, |j}, approaches a 
limit in the earlier sense. 

Notation. This symbol, Equation 2), shall have the following 
meaning : i) it asserts that fix) approaches a limit as x approaches 
a\ i.e. it vouches for the existence of a limit; and ii) it asserts that 
the value of the limit is the number h. 

Theorem. Let Ai be a subset of A having a as a cluster 
point. If fi^), regarded as a function whose domain of definition 
is Ay approaches a limit y when x approaches ay then f (x), regarded 
as a function whose domain of definition is A^y will also approach 
a limity when x approaches ay and the two limits will he equal. 
But the converse is not true. 

Unilateral Approach. If the points of A near a lie above a\ 
i.e. if X ay and if fix) approaches a limit, we may write: 

3) lim fix)\ 

with a similar definition for 

4) lim fix). 
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If, on the other hand, f{x) ^ b, we may write : 

5) lim fix) = 

Similarly, if fix) ^ b, we may write : 

6) lim fix) — b'~. 

x=a 

Of course, definitions 5) and 6) can be combined in all possible 
ways with 3) and 4). 

Becoming Infinite. The function is said to become positively 
infinite'. 

lim fix) = 4- oo , 
jr=a 

if to a number G chosen arbitrarily large there corresponds a S such 
that 

G < fix), 

where x is any point of (<1)^ which lies in A. 

The corresponding definition for becoming negatively infinite, 
lim fix) = — oo , 

is obvious. 

We say, f ix) becomes infinite : 

lim /(x) = oo , 


if \fiz)\ becomes positively infinite. 

A necessary and sufficient condition that fix) become infinite, 
or positively infinite, or negatively infinite, is that 


x^afix) 


Hm = 0+ 


TTT 

x=afix) 


The independent variable x may of course approach a unilaterally. 

Poles. When a function fix) becomes infinite at a point a, it 
is customary to say that the function has a pole at , and to write : 

fia) = oo . 

No statement is thereby made as to whether the function is defined 
in the point a, or if it is, what its vadue there is. Thus if 


X ^ 0; 


/(O) = 0. 
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it is true that 

y (0) = oo and /(O) = 0. 

The last equation states the value of the function when or = 0. The 
first equation has no concern with the value of the function when 
a: = 0. It makes a certain assertion about the function when x ^ 0, 

Independent Variable Becoming Infinite. Hitherto we have 
considered only the case that the domain of definition A of the 
function f (a:) has a cluster point x -= a. A has no upper bound, 
we say that f(x) approaches a limit when x becomes infinite (more 
precisely, positively infinite) if to an arbitrary positive € there cor- 
responds a number G such that 

Ifix') -fix") I < € 

for any two points x', x" of Ay lying in the interval 

G < X. 

This interval is the analogue of the abridged (^-neighborhood (S)a of 
the point x = a. There then exists a number b as before, such that 

& < X-, 

and we write : 

lira /(x) = b 

or, more precisely : 

lim f{x) = b. 

J?=»+o® 

The definition 

lim fix) = b 

Xssa^^iXi 


is now obvious; as are also the 
definitions 

lim fix) = b'^y etc. 

Exercisi: 

Illustrate each of these de- 
finitions by a suitable figure, 
carefully defined, such as is 
suggested by the diagram. 
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Exercises* 

1. Show that the function 

1 

y '=■ X sin -- 

X 

approaches the limit 0 when x approaches 0. 

2. Show that 

lim p = 0, ^ — T = 1 • 

3. Does the function 

^ = X sin :r 

become infinite when a: = oo ? 

4. Show that the function 

y = X 2 sin or 
becomes infinite when x = oo. 

Does this function steadily increase as x increases? 

5. If f {x] approaches a limit as x approaches a, and if 

^ 

show that 

A ^ lim f{x) ^ B. 

6. Let J {x) approach a limit wlien x approaches a, and Jet 
there be no {S)^ in which f{x) is constant. To a given c cor- 
respond inlinitely many values ot Show that, for any given € 
below a certain positive constant : e <C A, these ^’s form a liounded 
set, and this set has a maximum. 

§6. Bounded Functions. A function is said 

to be bounded at the point P if every neighborhood of P contains 
a point of the domain of definition A of the function and further- 
more there exists a certain neghborhood U of and a positive con- 
stant M such that 

l/Ui.- • •, x„) 1 < M 
for all points of A which lie in U. 

* In these Exercises, wliich serve solely as illustrations, the properties of 
the elementary functions are assumed. A systematic developemeut of these 
functions will presently he given. 
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Thus the function 

1 ) r = sin — 

X 

is bounded at tiie point — 0. Again, the function 

2) r — — . 0<Ca:^l 

X 

is bounded at every point of its domain of definition. 

A function is said to be bounded in a region if the region 
contains a point of and if there exists a positive contant M such 
that 

I < M 

for all points of A which lie in the region. 

Thus the function 2) is bounded in every point of its domain 
of definition, but it is not bounded in that domain. 

A function may be bounded at a point, as 

1 

V = sin — 

X 

at the point :r = 0, or it may have a pole at the point, as 

1 

j == — 

at the point x = 0. But 
these two cases do not ex- 
haust all the possibilities. 

Consider the function 

3) r= — . ^9^0- 

X 

This function is obviously 
not bounded at the point 
= 0, for sin^ = 1 when 
X = 1 /( 2 ' + 2At), and the 
function has the value 

I + 2^- 

But the function does 


X 
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not have a pole at the point = 0, For, sin i = 0 when x = \/kv^ 
and so the function vanishes there. Hence it does not become 
infinite when x approaches 0. 

We see, then, that the behavior of a function at a point involves 
a three-fold classification'. 

i) The function may be bounded at the point; 

ii) It may become infinite there; or 

iii) It may neither be bounded nor become infinite there. 

Oscillation. Let a function be bounded in a region. Let G be 
its upper limit and X, its lower limit. The difference : 

D = G-K, 

is defined as the oscillation of the function in the region. 

Let a function be bounded at a point a, and let be so chosen 
that the function is boimded in The lower limit of the oscil- 

lation D for such regions is defined as the oscillation of the 
function in the point a. 

§ 7. Three Theorems on Limits. Theorem I. If each of 
two variables^ X and T, approaches a Umit^ their sum approaches a 
limits and the limit of their swn is equal to the sum of the limits : 
lim (X + y) = lim X -f lim Y. 

We will prove the theorem for the case of functions of a single 
variable x with a cluster point x = a of the domain of definition, 
M. The proof admits of immediate generalization to all the higher 
cases that arise in point functions. 

Let the limits of X and Y he A and B. Let 

Then C suid f) are infinitesimals; i.e. variables which approach the 
the limit 0. More precisely, to an arbitrary c > 0 there corresponds 
a positive S such that 

1) I 4 1 < 0 < I a: — <z I < #, X in M. 

Similarly, 

2) I I < €, 0 < i a: — I < X in M. 

We may, however, without loss of generality drop the prime, setting 
S' = S, because a given S can always be replaced by any smaller 
positive S. 
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We wish to prove that, to a positive € chosen at pleasure there 
corresponds a positive S such that 

5) \A + B-{X +Y)\< €, 0<\x-a\< S, x in M, 

Now the €’s that appear here — the € of 1) and 2), and the € 
of 3) — are of different origins. The first € (call it cO is a number 
at our disposal. We can choose it to suit our purposes. But the 
second € pertains to the conclusion. It is given us, as it were, by 
our adversary, and we have to meet it, — to find a S that will 
match it and make 3) a true relation. In other words, we have to 
prove that to the € of our adversary corresponds a positive S such 
that 3) is true, or : 

4) |C+|}|<€, 0<|a:-a|<#, 

it being understood henceforth that x lies in M. 

To do this we infer from 1) and 2) that 

I4l + l»ll<2c'. 0<|x-«|<#. 

Furthermore, 

1C + »]I = lci + i»?l- 

Hence 

ic+i)l<2€', 0<lx — «!<#. 

If, then, we choose our e' so that 2 ^ e, the relation 4) will 

be fulfilled, and thus the theorem is proved. 

Theorkm n. If each of two variables^ X and T, approaches 
a limits their product approaches a limity and the limit of their 
product is equal to the product of their limits: 

lim (X r) = [ lim X ] [ lim r ]. 

We wish to prove that to an arbitrary positive € corresponds a 
positive 8 such that 

5) |^B-Xri<€, (}<\x-a\<8. 

And we know that, when we decide on an > 0, we can find a 
# > 0 such that 

Itl<*', 0<\x-a\<S. 

Now, 


Xr=:AB + BC + Ati + iti. 
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Hence 

U£-xri = |54 + ^i + dTl 
^ Ifil IC +MI !•}! + I4i hi g [Ml + |Bi +£'j£'. 

It remains merely to show that we can choose our so that 
this last expression is less than our opponent’s €. This can be done 
conveniently by first restricting e' to be < 1, and then restricting 
c' further by the conditiotiL : 

( M I + I J5 I + 1 ) €' ^ €. 

Thus the proof is complete. 

Theorem III. If each of two variables^ X and T, approaches 
a limits and if lim T ^ 0, then the quotient X/ Y approaches a 
limits and the limit of the quotient is the quotient of the limits: 

lim (y j - limy' 

The relation which here corresponds to 3) and 5) above, is : 

6) 0<|:r-a|<^. 

Now, 

B Y B B+.J BY ' 

First choose S so that 

1 > i IBI 

Then 

i^l-h! + I5I-I4I 

W ’ 

and the remainder of the proof presents no difficulties. 


^ _ X 
B Y 


Exercises 

1. If X approaches a limit, and if C is a constant, then 
lim (X + C) = Urn X + C; 
lim (CX) = ClimX; 



C 

limX 


, provided lim X ^ 0; 


lim X" = ( lim X )". 
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2. If Xi, • • • , X„ are variables, each of which approaches a 

limit, and if Cj, * • •, are constants, then 

lim (Cl Xi -\r * * * + Cn X„) = Ci lim Xi 4* • * • + C„ lim X„. 

3. If, furthermore, Ei^ En are constants, then 

lim ^ 1-^1 * 4“ Cn X fi _ Cl l im Xi + • • • 4- C^ lim Xn 

E,X^+---\-EnXn ^ilirnXi 4* * • • 4- EnWmXn' 

provided 

El lim Xi 4- • • • 4- lim Xn ^ 0. 

4. Show that, ii f {x) \s a fimction which is bounded at the 
point :r = fl, and if 

lim ip (x) = 0, 
x=a 

then 

lim f (x) ip {x) = 0. 

x—a 

5. If G (x) is a polynomial in x : 

G(x) = CoX^ -h Cl x^'~^ 4 h c„;. 

and if X is a variable which approaches a limit, then G (X) ap- 
proaches a limit, and 

lim G(X) = Co (limXr-j-CiihmXr-^ 4- * * * 4-c„. 

6. State and prove an analogous theorem relating to the quotient 
of two functions ; 

y(-^) 

/W • 

7. If each of the variables Xi, Xo, • • •, X„ approaches a limit, 
and if F {xi^ • • Xn) is a polynomial, then 

F(Xi, ••*,X„) 

approaches a limit. 

8. In only one of the foregoing questions is an € -proof required. 
Which one is it? 

9. Each of Questions 1 — 7 contains one or more existence 
theorems. Did you prove the convergence., i. e. the existence of the 
limit, each time? 
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§8. Continuous Functions. Let /(x) be a function defined 
in the points of a set and let x = a be a cluster point of A. 
The function is said to be continuous a if i) f{x) approaches a 
limit when x approaches a\ ii) the value of this limit is f{a)i 

lim fix) =fia). 

x=a 

By § 4 this means that, to a positive € chosen at pleasure, there 
corresponds a S > 0 such that 

l/(^)““/U)l < |x— < J, X in A. 

The function is said to be continuous in A if it is continuous 
in every point of A. 

The region A will usually consist of an interval, open or closed, 
finite or infinite. By a closed interval (/z, h) is meant, we recall, 
the set of points 

a ^ X ^ h. 

The definition may be illustrated geometrically as follows, Fig., 
p. 73. Plot the point (a:, jy) = (« , 2>), where h’==-fia). Draw the 
horizontal parallels 

The point (fl, h) lies within the strip bounded by these lines. And 
now the definition says that there is a vertical strip bounded by the 
lines 

x = « + x^ a — S 

such that, when x lies between a — # and the corresponding 

point ix^y) lies in the rectangle common to these two strips. 
Example 1. Consider the function : 

y(a:) = x, when x is rational; 

y* (x) = — X, when X is irrational. 

This function is continuous for or = 0, but for no other value of x. 
Example 2. The function: 

y(ar) = 1, X irrational; 

fix) = 0, X rational, 

is bounded. It is discontinuous for all values of x. 

Example 3. Let fix) be defined in the interval 0 ^ x ^ 1 
as follows: 
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i) /(0)=/(l) = l; 



where p/n\ \s a point of the interval, in which ^ has not yet 
been defined. 

Finally, /(x) = 0, x irrational. 

This function is discontinuous for all rational values of jt, and 
continuous for all irrational values. 

Example 4. The function (x) obtained from the function 
f (x) of the preceding example by periodicity : 

y(x)=/(x), 0 < X g 1 ; 

^(x+l) = y(x), — oo<x<co. 

Theorem 1. ^ cojttinuoiis in the point x — ^, then 

f {x) is bounded in this point. 

jy f ^ 0, then fix) does not change sign or vanish in the 
neighborhood of x — I- More precisely: 

If fii) > c, then 

c < fix) 

. in a certain neighborhood of 
If fit) < c, then 

fix) < c 

in a certain neighborhood of £. 

The proof follows from the fact that 
/(£)-« </W </(£) + «’ lx-£|<<r, X in 

on setting € = I I 

Theorem 2. A continuous function of a continuous function n 
a continuous fwictiofu 

More precisely, let y - ip (r) he continuous in a given point 
set A. and let 
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^=f{y) 

be continuous in a point set B. Let \ y\ be the point set defined 
by the values of <p{x). Let B contain \ y \. Then the function 

“ =/[f W] 

is corUinuous in A, 

The proof is left to the reader. 


Exercises 


1 . If y (x) and <p (x) are continuous in the point x — a or in 
the region A, then 

i) /(■r) + f(x), 

ii) fix) fix), 

are continuous there. Moreover, 


fix 


is continuous in a or in a point J of A, provided fia) ^ 0 or 

fii) ^ 0. 

2. The function 

X 

is continuous for all values of x. Give a careful €-proof of this 
theorem, 

5. The function 


y = « = 2, 5, 4, • • •, 

is continuous for all values of x. Prove this theorem without the 
use of c’s, employing only the theorems of Question 2 and § 7. 

4. Every polynomial in x is continuous for all values of .r, 

5. A rational function 




^(x) 


where f (:r) and f ( r) -f- 0 are any polynomials in x, is continuous 
lor all values of x for which V’(x) 0. 

6. If a function is continuous in a closed interval and vanishes 
tliere, show that its roots form a closed point set. 

Is the theorem true if the interval is bounded, but not closed? 
Give an example. 
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7. Plot the graph of the function : 

f {x) = X sin — , x ^ 0 ; 

X 

/(O) = 0. 

Prove that the function is continuous for aU values of x. Assume 
that sinx is continuous and bounded. 

§9. Three Theorems on Continuous Functions. 

Tiieorkm 1. ^ function f{x)^ continuous in a closed interval^ 

a ^ X ^ hy 

is hounded. 

Assume the theorem false. Divide the given interval, (a, b)^ 
into two equal subintervals. Then the theorem must be false for 
at least one of these. Iiet 

«.1 ^ X ^ Pi 

be such an interval. If there is a choice, take, for definiteness, the 
left-hand interval. 

Repeat the reasoning, subdividing (ai, Pi),. and denoting a sub- 
interval in which the theorem is false by 

tt2 ^ X ^ Pj. 

If there is a choice, take, for definiteness, the left-hand interval. 

Proceeding in this manner we obtain a succession of numbers 

ttn: 

W-I ^ ^ tt„ < Pi ; 

and a second succession : 

Pi ^ 02 = Pn ^ • 

Moreover, 

Pn-®" = m ^ n. 

These numbers determine a point £ such that 

i ^ Pn. 

Since y’(x-) is continuous in x = £, we have: 

•l/(i)-/(^)l < «. \x-i\<g, 

or 

l/(x) i < 1/(0 I + «. \x-t\<S. 
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Let m be so chosen that 

Pm O'm ^ 

Then the interval (a^, Pm) lies within the interval (£ — <?, £ 4* ^)» 
and here is a contradiction ; for in no interval (a„, fin) is the func- 
tion bounded. This proves the theorem. 

Remark. Observe that the theorem is not true for an infinite 
interval, — witness the function 

y =■ X. 

And it is not true for a finite interval which is not closed ; witness 
the function 

y = — , 0 <. X ^ 1. 

X 

Theokkm 2. If a function f{x)y continuous in a given interval^ 
changes sign, it vanishes at a point of the interval. 

In this theorem it is not necessary that the interval be closed. 
It is enough that it be connected ; i.e. if a and h are two of its 
points, then the closed interval (a, b) shall belong to the given 
interval. 

Let be a point of the interval. If f{a) = 0, we are through. 
If not, f{x) must change sign to the right of zz or to the left of a. 
Suppose the fomier is the case. Then there will be an interval, • 

a ^ X <. y 

in which f {^x) does not change sign ; Theorem 1, § 8. Let ^ be the 
upper limit of all such numbers, $ . Then £ is an interior point 
of the interval of definition, and 

For, if ^ 0, then there will be a certain neighborhood of ^ in 

which f {^x) will not change sign. But this is in contradiction with 
the cissumption that £ is the upper limit. 

Thi:()iu:m 3. A f unction f {x), continuous in a closed interval, 
a ^ X ^ b, 

has a maximum and a minimum. 

By a maximum is here meant a value, M, taken on by the 
function in one or more points of the interval, and not exceeded in 
any point : 
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fiV) = for some a S ^ S. h \ 

f {j^) ^ M for every x, a S x h. 

Similarly for a minimum. 

For example, the function 

y — const. 

has a maximum in every point x: = ^ of the interval ; and it also 
has a minimum in ever}^ point. 

Again, the function 

f{x)^x, 0 ^ a: g 1 ; 

fix) = t, 1 < X ^ 2; 

fix) = 3 — JT, 2<x^5 

has a maximmn in each of the points 1 = £ ^ 2 and a minimum 
in a: = 0, 5. 

Proof, Consider the point set \ y \y where 
y=fix). 

It may consist of a single point. In amy case, by Theorem 1, it is 
bounded. Let M denote its upper limit. 

The theorem asserts that the point set has a maximum, i. e. 
that M is a point of the set. 

Assume the theorem false. Then f {a) <C M. Let y be a 
number between f {a) and M : 

fia) < y< M, 

The equation 

fix) -y = 0 

has roots, by Theorem 2, and these foim a closed set, by § 8, Ex. 6. 
Let £ be the smallest root. 

Assign to y a succession of values : 

yi < y 2 < • • y„ = M. 

n - oo 

The corresponding roots will have the property : 

£i £2 ^ * * *» £n 

Hence £n approaches a limit : 

lim £„ = £, 
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and $ is a point of the interval (a, b), since this is closed. It follows, 
then, from 

yn=f{in) 

and the continuity oiy{x)y with the aid of §5, Theorem, that 

lim = li n fUn) — /(hm £n) 

or 

M^fia q^e.d, 

Exkrcisks 

1. Prove Theorem 1 by the method used for Theorem 2; i. e. 

begin with an interval a x in which y*(x) is bounded. 

2. Prove Theorem 2 by the method used for Theorem 1. 

3. Give two new proofs of Theorem 3. 

4. Devise a new proof for* Theorem 1. 

5. The same for Theorem 2. 

6. Prove the following theorem. Let f^x) be positive in every 
point of a closed mtervaJ, and let it have the lower limit 0. Show 
that there is a point of the interval, in every neighborhood of which 
the lower limit is 0. 

7. Let f (a:) be defined in the interval 

a X S 

and let it be bounded from above. Let it have no meiximum. Sliow 
that a set of values .r^, .r 2 , * * • exists having c as their sole cluster 
point and such that 

lim f{xn) — G, 

where G is the upper limit of the function f (t). 

8. If the function 

7 =/W 

is continuous in the interval 

a ^ X b 

and is mono tonic increasing : 

/(x') < /U"), < x", 

show that the inverse function : 

x = F{y), 

is monotonic increasing and continuous. 
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§ 10. Uniform Continuity. To say that a function, f{x), 
is continuous at a point means that to a positive € chosen at 
pleasure corresponds a (T > 0 such that 

\f{x!) — /*(x) 1 < €, I X — y 1 < <^, x, a/ in 

Let €, once chosen, be held fast, euid consider the Sh correspond- 
ing to the different points x* of A. These S's will in general be 
different for different x^’s, and even when the maximum is chosen 
each time, it may sink below an arbitrarily chosen positive constant, 
h. For example, if 

f{x) = — , 0 < X ^ 1, 

X 

the value of S obviously drops below any given h for some values 
of X*, 

But this is not the case, for example, with the function 

fix)=x^, 0 ^ X ^ 1 . 

The worst points x'; i. e. those for which S has its smallest value, 
are obviously those for which the graph of the function is steep- 
est — here, = 1. And so we can set 



and this S will fit any x' of the intervaj. 

We axe thus led to the following 

Definition, A fimction f{x) is said to be uniformly coiUmuous 
throughout its domain of definition. A, if to an arbitrary positive t 
there corresponds a fixed positive S which will apply to any point 
x' of ^ : 

1) \f{^) f{^) I I X — x' I < ; X, x^ 'm A \ 

<y, independent of x, x'. 

Thkorem. a function f (x) which is continuous at every point 
of a closed interval {a, b) : 

a ^ X ^ b, 

is uniformly continuous throughout that interval. 
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Pi'oof, Let € be an arbitrary positive number, once cliosen and 
then held fast. We wish to show that a |x>sitive constant, S, exists 
such that 

2) l/U') — /U') I < «. 1 A- - -r' I < S. r. x' in 4. 

When a subinterval 

^ a; //, a S a' < 1/ S b, 

is sucji that, for some fixed S' > 0, where S' depends on A'\ but 
not on X, x', the relations hold : 

\f {x) — f (x') I < €, I in A'^ 

we shall say that A' is of Class (c). This is the particular € chosen 
at the outset. It does not change in the reasoning that follows. 

If two intervals, A' and A", each of Class (c), overlap, it is 
obvious that the composite interval made up of A' and A" is also 
of Class (c). 

There exist intervals of Class (c). For, since ^(x) is continuous 
at X = a, we can clioose J € and then find a #o > 0 such that 

1 /U’)““/{^)l < ^ X — a < Sq. 

Then 

\fix')—f{a) \ < €', 0 ^ jr' — a < S^. 

Hence 

l/(a:)-/(y)l < 2 c' = €, 

0 ^ X — a < <yot 0 ^ x' — a < (^Q. 

If, then, we choose y so that a <. y <. ^ + interval 

3) a S- X ^ y 

will be of Class (c). 

Consider the totality of intervals 3), y now being unrestricted, 
which are of Class (c). Let | be the upper limit of the y’s. We 
^vill show that ^ = b, and that b is a y. 

Sinr.e f ( r) is continuous at we can choose = i € and then 
find a Si > 0 such that 

i/ U*) —/ ($)!<€', 1 X — £ i < <^1, X in A. 

We now infer as above that 


U- - i I < Ji, 


i/U)-/U-')l < 


X, x' in A, 
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Thus if be chosen between 0 and or: 0 < S[ < Ji, the 
interval 

4) £ — ^ X ^ £ -f X in A, 

will be of Class (c). 

On the other hand, there is a value yi of y arbitrarily near 
and so, in particular, 

Thus the interval 3) for y = yi, overlaps 4). Hence £ = and b 
is a y. This proves the theorem. 

Second Proof, The theorem can also be proved as 'follows. 
Assign to each point x of the interval the maximum value of S for 
which 

\f{x)—f{J) \ < «, \x — 3/\ < S, a/ m A. 

Here, € is the fixed value chosen at the start. Thus a positive 
function, S = S (x), is defined in each point of the interval. We 
wish to show that its lower limit is positive. Suppose it were 0. 
'Then the point set {x, S ) in the (jr, jy) -plane would have a cluster 
point (c, 0). In fact, if (a, 0) is not such a point, let the interval 
a^x^y^b he free from cluster points. Ihe upper limit 
of y is a point c, corresponding to a cluster point. 

This leads to a contradiction. For, the function being continuous 
in c, we have : 

l/W— /W1 < €', jj — c| < <f', X in A; 

also : 

\fic)—f[x') \ < lx' — c| < J', x' in A. 

Hence 

\f(x) —fix') I < 2 
where x is any point of the interval 

c — S' < X < c + <y', 

and \ X — x' \ < i S', both points, x and x', lying in A, Now 
choose c' = J €. I'hen S {x) ^ i S' throughout this interval, and 
so (c, 0) cannot be a cluster point of the set. 

Third Proof, Still anotlier proof can be given by means of 
the Covering Theorem, § 11. Begin as in the Second Proof with the 
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system of maximiun d’s. Then the interval can be covered by a 
finite number of overlapping intervals : 

< x< i + 

where 5 takes on successively each of a finite number of values. If 
h is the length of the shortest interval common to two consecutive 
overlapping intervals, 

jk ^ Six) 

for every x of the total interval. 

Exercises* 

1. Show that the function 

1 

is uniformly continuous in its domain of definition. 

2. Is the function 

fix)-=e* 

uniformly continuous i) in its domain of definition? ii) for positive 
values of x? iii) for negative values of x? 

5. Show that the function 

jy = log X 

is uniformly continuous in the region 1 ^ x < + oo. 

4. Is the function uniformly continuous? 

5. If a function is uniformly continuous, is it bounded? 

6. If a continuous function is bounded, is it uniformly con- 
tinuous ? 

7. Ify*(x) is uniformly continuous in the interval 

a ^ X < by 

show that it approaches a limit when x approaches h. 

8. If J (x) is continuous in each point of the interval 

a < X ^ b 

and if / (x) approaches a limit when x approaches show that 
/(x) is uniformly continuous in the above interval. 

» In working these Exercises make use of what you know alwut the 
Calculus. 
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9. Show that a continuous periodic function is uniformly con- 
tinuous. 

§11. The Coverinjf Theorem. To each point x of a closed 
point set { X j let an interval including this point he assigned. 
Then it is possible to include all points of \x \ in a finite number 
of tnese intervals r,. 

Let a and b be respectively the minimum and the maximum 
points of { :r j. Let {a, y)i 

a ^ X ^ yy 

be an interval w^hich can be covered by a finite number of intervals 
Such intervals exist, for any interval (a, y) included in ra is 
one. Let £ be the upper limit of the y’s. Then i = b and b is 
a y. 

For, since the interval extends beyond £, it is impossible for 
£ to be < Hence £ = ^. Consider the interval r^. It extends 
to the left of b, and so £ cannot be merely an upper limit for the 
y’s — it must itself be a y. This completes the proof. 

Second Proof. A second proof, more convenient in space of n 
dimensions, is the following. I^et x be any point of { x }. Then a 
certain <f -neighborhood 

O’ : < 5* < A: = 1, • • • , 71, 


is contained in r^. But a larger neighborhood, not even contained 
in r^, may be included in some 

other Tg,, Let Sg be the upper 

limit for the J’s corresponding to ^ i T | | | 

the point (x) ; denote the corre- 
spending o* by Og. 

It is obviously sufficient to show that \ x j can be covered by a 
finite number of (Tg^s. This will surely be so if the lower limit of 
Sg is positive. If this were not true, there would be a point (£) of 
S X j, in every neighborhood of which Sg sank below an arbitrary 
preassigned €. But this is impossible, since such a neighborhood 
would come to lie within or^. 

§12. The Axiom of Choice. I-et \x\ be a bounded infi- 
nite linear point set. We have proved that it must have a point of 
condensation, x = c (Weierstrass-Bolzano Theorem, § l). It would 
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seem, then, clear that we can pick out a subset, ^2^ * • *, from its 
points such that 

lim Xn — c. 

For, let be any point of the set distinct from c. Choose 
€ <C \ c — X \ and mark off an interval 

C— € < X < C + €. 

Choose a point X2 of the set lying in this interval and distinct from 
c. Then choose a smaller interval and repeat the process. Thus a 
succession of points Xi, Xo. x-^^ • * • is determined. 

Now comes the difficulty. In the process just described we have 
assumed an infinite number of independent choices. What we need 
is a law whereby the n-th point is deteriiiined before n is named. 
We do not know, for example, what the n-th digit in the decimal 
expression for {/~I is; but each digit is determined before we say 
what n shall be. 

There seems to be no means of laying down such a law in the 
general case of the point set just considered. And yet, the existence 
of such a set of Xn seems highly plausible — it w'ould be little short 
of perverse to deny its existence. Moreover, an important part of 
modem analysis has been built up on the tacit assumption that such 
a set exists. 

Zermelo was the first to point out this lacuna. He met the 
difficulty by introducing a new axiom, which may be formulated as 
follows.* 

7 HE Axiom Or Choice. Let each point set A in space of n 
dimensions determine a point P of that space. Then there exists 
such a determination whereby P is a point of A. 

The word determine is here used in the same sense as in the 
case of defining a function. Each point set A is transformed into a 
point P by a law such that, when A is najned subsequently, the law 
already has its answer, P. 'Fhus, to each A might correspond the 
origin of coordinates. And now the axiom says that, in this manifold 
of laws, there is one whereby P is a [X)int of A for each A. 


* Cf. Caratheodory’s presentation of this subject, Reelle Funktionen^ p. 33. 
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Thus the determination of P in does not come after A has 
been named, but assigns P to A before A enters the specific con- 
sideration in hand. Or, still in other words, whenever we select a 
point set A^ one of its points, P, has already been determined, and 
is waiting for us. 

Returning now to the example with which we opened the dis- 
cussion, let us proceed more systematiccilly, beginning with a set of 
positive decreasing c’s: 

0 < < €„, lim = 0 , 

and defining intervals 

Rn-. C — £„ < X < C + €„. 

Ijet An be the subset of the given set which lies in Rm the point c 
excepted : 

0 < I X — c 1 < €„, X \a An. 

And now, by the Axiom, there already exists a point Xn of An\ 
it does not have to be chosen after we arrive at An> It is already 
there to meet us. 

These XnS define a function of n having the property that 
|c — < €„, m ^ n, 

and so Xn approaches c as its limit:* 

lim Xn = c. 

hsaoo 

A further illustration of the use of the Axiom appears in the 
proof of the following 

Theorem. An arbitrary infinite point set M in space of n 
dimensions contains an infinite denumerable set Pj, P2, • • • . 

Proof. Begin with M. To it is assigned a point P by the 
Axiom. Let this be the point Pi. 

Let Ai be the point set consisting of M less the point Pj. 
Then there is already wedting for us, by the Axiom, a point P of 
Ai. Let this be the point P2. 

Repeat the process, taking as A^ the point set Ai less P2. Then 
a point P of A^ is already determined by the Axiom. This shall be 

• In this proof, it may happen that the corresponding to two different 
values of n are ecpial. For a given n, only a finite number of such coincid* 
ences are possible, dnd they may all be avoided by replacing the total set of 
intervals R„ by a suitably ^osen subset 
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the point P3. And so on. We see that the point P„ existed before 
we began, just as the 72-th digit in the decimal for -j/ 2 existed be- 
fore we began. 

Rxkrctsfs* 

1. "I he fFeierstrass-Bolzano Theorem. Extend the theorem to 
point sets in space of n dimensions. Begin with the plane and divide 
it into squares by the lines 



Consider those squares which contain an infinite number of points of 
the set in their interior imd on their boundary. Devise some way of 
picking out such a square so as to avoid the error of the Auswahls- 
prinzip (Principle ot Choice). Carry the proof through in detail, and 
generalize. 

2. The S -Neighborhood of a Point and a Point Set. Extend 
the definition given in Chap. II, § 6 and Chap. Ill, § 5 to a point 
and a point set { r: j in space of n dimensions by means of the standard 
element, 

— 8 < S , A: = 1, • * •, 72. 

3. Convergence, l^t a sequence of point sets { r: j in space of n 

dimensions : Afo, * * * be given, their points being denoted by 

{x) = (r-j, • • ', Xn)- Then A/^ shall be said to converge when k — 00 
if, to an arbitrary positive € corresponds an integer m and a point 

• • • , of Mm such that each {m ^ k) lies in the 
€ -neighborhood of ($). 

Show that there then exists a unique point (a) = («], • • • , an) 
such that to an arbitrary positive e corresponds an integer m for 
whi( h Mk lies in the € -neighborhood of {a) wlien m = k. 

I’lie point {a) is called the limit of \x \ or 

lim j a: S == {a) or lirn = (a). 

• Diese Exercises need not all be worked at this stage. It is well for the 
student now to extend his horizon. He may well leave the detailed study of 
this subject until he has bedoine familiar with the application of the theory 
he has already studied. 
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4. Limit of a Function. Let ^ • • • , x„) be defined in the 

points of Question 3, and let 

J =/ (^ 1 . • • * » 

Let j j be the succession of point sets corresponding to Mj^. If 
Nji converges, the function f (^r^, • • • , x„) is said to converge, and 
its limit is defined as lim — 

(x)^ a) 

By this last equation is meant: i) thaty^C^i, • ••, x„) converges 
{existence of a limit) ; ii) that the value of the limit is b. 

5. Extend the definition of Question 4 to the case that Mj^ 
lies in a plane and 

lim Xi = a, lim = co. 

i=;o jr=ax3 

Generalize for the two-dimensional case. 

6. Give a generalization of Question 5 for higher spaces. 

7. When is a function /(^i, * ^/i) said to be hounded, i) in 

a point; ii) in a region? When does the function have a pole in a 
point ? 

8. Define continuity for a function f{xi, • • Xr^. 

9. In what points are the following functions continuous? 


i) 


X — y 
X y' 


ii) 




or -f j- 


iii) 


3? y^ 
jP’ ^ * 


10. What of the fimctions in Question 9 approach limits when 
(x, y) approaches (0, 0) ? 

11. Show that the function 


approaches a limit along each straight line through the origin. 

12. Extend Theorems 1 and 2 of § 8 to functions of several 
variables. 

13. Show that a rational function : 


R (a:i, • • •, Xn) = 


/fa. 

<Pfa. 



where /fa, and j?fa, are polynomials prime to 

each other, i$ continuous at all points at which it is defined. 
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14. Does R {xi, • * Xn), Question 15, have a pole at a point 
in which ip {xi, • • • , x^) vanishes ? 

1 5. Extend Exs. 1 and 6, § 8, to functions of several variables. 

16. Extend Theorem 1, §9, to functions of several variables. 

17. The same for Theorem 3, § 9. 

18. Theorem 2, § 9, can be generalized as follows. Let 

f{xi, be continuous in a connected region of /z-dimensional 

space. I^t it be positive at one interior point of the region, and 
negative at another. Then the function has a root in the region. 

19. Generalize Exercise 6, § 9. 

20. Generalize Exercise 7, § 9. 

21. Uniform Continuity. A function f {x^, • • *, XjPj, defined in 
the points of a point set A, is said to the uniformly continuous 
there if to an arbitrary € > 0 corresponds a (? > 0 independent of 
(x) and such that 

where {x^) is any point of A and {x) is any point of A within the 
<y-neighborhood of {x^). 

State and prove the generalization of the Theorem of § 10 for 
this case. 

22. If a function f {xi., is uniformly continuous in an 

open region, il, and if P is a boundary point of R, show that the 
function approaches a limit when (x) approaches P, always remain- 
ing in R. Assume only such boundaries as are analogous to the 
surface of a polyhedron in space, or a simple regular curve in the 
plane. Chap. VH, ^ 10. Begin with the case n = 2. 

23. If the definition of the function in Question 22 be sup- 
plemented by setting it equal in each boundary point to the limit 
which it approaches there, show that the extended function is con- 
tinuous in the closed region. 

24. If /(-Ti, • • •, .r„) is defined in the points of a closed set, 
A, and is positive, show that there is a point of A^ in every neigh- 
borhood of which the function comes arbitrarily near its lower limit. 

25. Covering Theorem. Extend the Covering Theorem to a 
closed set in space of n dimensions, and prove it. 
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§ 1. Derivatives. Let a function f {x) be defined in the neigh- 
borhood of a point, x = Xq. Form the difference-quotient : 

/(.To + Ax) — /(xq) ^ 

Ax 

where Xq -f Ax is a point of the above neighborhood, distinct from 
x^i. If the quotient approaches a limit as Ax approaches 0, the 
function is said to have a derivative, or be differentiable, at the 
point Xq. We write: 

2) Urn /(-^u + -/M = . 

^^=0 Ao: 

If the ratio 1) approaches a limit when Ax approaches 0 passing 
only through positive values, f{x) is said to have a forward deritj- 
ative. And siinilaidy for a backward derivative. If, and only if, 
these two are equal, will f{x) have a derivative in the point Xq. 
But if Xq is an end point of the doaiain ot* detinition of f{x), then 
f (x) is said to have a derivative in the point Xq if the forward or 
backward derivative exists. 

If a function has a derivative in a point, the function is continuous 
in the point. But the converse is not true, as vvill presently be shown. 

If the difference- quotient 1) becomes infinite as Ax approaches 
0, the function is said to have an infinite derivative. In particular, 
we ma^*^ have 

f(x(^ -f Ax) — f (x^) 

Iim — — = -h oo, or — oo ; 

Ao: 

and similarly for lirn Ax = 0"". When, however, we say of a func- 
tion that it has a derivative, we shall use the word only in the 
sense of a proper derivative, and exclude the case that the difference- 
quotient becomes infinite. 

If f{jx) has a derivative at every point of an interval, open or 
not, the function is said to be differentiable in the interval. 
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Example 1. The function 

y --\x\, — oo < jC < oo, 

is continuous for all values of x. It 
has a derivative when x ^ 0. In the 
point x = 0 it has a forward derivative, 
the value of which is + 1 ; and a back- 
ward derivative with the value — 1. 

Since -f 1 ^ — 1, the function has no 
derivative at the origin. 

Example 2. If, however, we take as the domain of definition 
the interval 

0 ^ X < + oo, 

or, again, the interval 

— CO <C X ^ 0, 

the function 

r = \x\ 

has, in each case, a derivative at every point. 




1. If a function has a forward derivative at a point, and also 
a backward derivative at the point, show that it is continuous at the 
point. 

2. Show that the function* 


/(O) = 0 

* Again we point out that we are using the elementary functions only for 
the conv''nicnce of illustration. The examples could be constructed without 
them. The theory is in no wise dependent on them. Tlie elementary fimc- 
tions will presently be developed systematically. 
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is continuous tor all values ot x, but that, at the point =• 0, it 
has no derivative. 

3. It’ each of two functions, fix) and (fix), has a derivative at 
the point .r = a, show that each of the functions 

f{x) + <p{x), fix)<p{x) 

has a derivative there, also. And the same is true of the function 

/(^) 

^{x)' 

provided <pia) ^ 0. 

Give an explicit reference to each theorem you use in the proof. 

4. Show that the function 


y = X 

has a derivative for all values of x. 

5. The same for 

r = c, 

where c is a constant. 

6. Prove : 

DgX^ = nx^~^^ 
where « is a natural number. 

7. Show that a polynomial : 

G{x) = aQ3p + + ••• + a„, 

has a derivative. 

8. Show that a rational function: 


Ri^) = 


^F{x) ’ 


where Gix), Fix) are polynomials, in general has a derivative. 
What are the exceptions? 

Are G(a:), Fix) any two polynomials? Answer explicitly. 

9. If the function 

xf{x) 

has a derivative at a given point, Xq ^ 0, and if fix) is continuous 
there, show that f (a:) has a derivative there. 

10. In Questions 3/9 an €-proof was required in three cases. 
What were they ? 
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§2. Continuous Function without a Derivative. Con- 
sider the function 


f{x) = X s 

/(O) = 0. 


7 ^ 0 ; 


It is continuous at the origin, but it has no derivative there. For, 

/ (.To + Ajt) - / (jTq) _ 1 

Ax Ax 

and this variable approaches no limit, /l\ / r\ 

but oscillates between -j- 1 and — 1 l /A / 

as dkX approaches 0. U''^ 

On the other hand, the function 
1 

C /W = a:-sin— , x 0; 

2) ^ ^ NT 

I /(0) = 0 ^ 

has a derivative at the origin, since / x 


• (xq + Ax) — /(xq) _ 
Ax 


Ax sin- 



and this variable approaches the limit 0. 
Observe, however, that 

tan r — Dx y '==■ {^) 

is not a continuous function. For, 

y' {x) =-2 X sin cos — , 


X ^ 0, 


and when x approaches 0, this function approaches no limit. The 
explanation is simple, when one looks at the graph. For, as a point 
P moves along the curve, approaching the origin, the tangent oscil- 
lates and approaches no limit why should it? Nevertheless, the 
curve has a tangent at the origin. 

The function 

4 1 

C /(x)=xssin— , X 0; 

5) / X 

I /(O) = 0 
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has a derivative for all values of :r, but the derivative does not remain 
finite at the origin. Its value at the origin is 0. 

It is easy to form an example of a continuous function which 
fails to have a derivative in the points of a set everywhere dense; 
Weierstrass* was the first to give an example of a continuous func- 
tion which nowhere has a derivative. An example simpler to follow 
in detail has recently been given by Perkins.** 

§3. Rolle’s Theorem. Let ip{x) be continuous in the closed 
interval 

a ^ X ^ by 

and let 

<p (a) = 0, <p (b) = 0. 

Let if (j:) have a derivative at the interior points, 

a <, X <. b. 

Then the derivative vanishes at an interior point: 

f'(X) = 0, a < X < b. 



Proof. If (p (x) -:h= 0, the truth of the theorem is obvious. In 
all other cases the function will take on positive or negative values, 
or both. Hence the function will have a maximum or a minimum 
inside the interval; Chap. Ill, § 9, Theorem 5. Suppose it has a 
maximum at x = X. I’hen 

^(X-hh) ^ ip{X) 
for all values of h numerically small. Thus 

h 


^ 0 , ^ < h-, 

^ 0, A < 0. 


* Cf. C. Wiener, Journ, fiir Math, voL 90 (1881) p. 221. 

** F. W. Perkins, Amer. Math. Monthly^ vol. 54 (1927) p. 476. 
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Since ip (x) by hypothesis has a derivative at x ^ X, this difference- 
quotient must approach a limit as h approaches 0. The forward 
derivative is ^ 0; the backward derivative is ^ 0. Hence the 
derivative is 0, q. e. d. 

The importance of this theorem lies in the fact that its proof is 
purely arithmetic^ not based on geometric intuition, but solely on 
the theory here developed analytically. 

§4. Law of the Mean. Let f{x) he a function continuous 
in the closed interval a ^ x ^ and let it have a derivative at 
each interior point: a <. x <, b. Then 

f{b) -f{a) = {b- a)f{X\ a < X < b; 
or 

f{a + h) =fia) + hf{a + Oh). 0 < 9 < \. 

Proof, Form the function; 

<p{x) = {x — a) [f{b) —/(a)] - {b — a) \J{x) — f{a)]. 

This function satisfies all the conditions of Rolle’s Theorem. Hence 
its derivative, 

=/(6) -/(«) -{b- a) fix), 
must vanish within the interval; 

fiX) =fib) -fia) -ib- a) fix) = 0, a < X <b. 
From this equation the theorem follows at once. 

Again, a theorem the truth of which is, geometrically, intuitively 
obvious — for must not a tangent 
be parallel to the secant, or 

fib) -fia) 
b a 

— has been proved arithmeticallY 
with the analytic means here at 
our disposal. 

As a first application consider 
the theorem that a function f{x) 
whose derivative vanishes identically^ is a constant. Let x and a 
be two points such that the closed interval (/z, x) lies in the domain 
of definition. Then 

fix)-fia) = ix-a)fiX) = Q. 
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A corollary of this theorem is the fact that if two functions^ 
,f{x) and <p{x), have the same derivative, 

fix) ip' {x\ 

they differ by a constant: 

fix) =<pix) -{■ c. 

§5. Differentiation of Composite Functions. Differ- 
entials. Ijet 

be a function of y, defined in the neighborhood of the point y = ro 
and having a derivative in that neighborhood. I^t 

J (x) 

be a function of x, defined in the neighborhood of the point x = Xq 
and having a derivative in that point. Finally, let 

9 (^o) = Jo- 

I'hen u, regarded as a function of xi 

U =f[ipix)\ 

has a derivative in the point x = Xq, and 


DxU — DyU Dxy. 

For, let 

d^y — ip [xq + Ax) — ip (xo), 

where | Ax | < h and h is so chosen i) that the points 

I X — Xq I < 'A 

lie in the second neighborhood and ii) that the point y^ + Ajy lies 
in the first neighborhood. Then, by the Law of the Mean, 


Hence 


Am =:/(jo + ^y) ~/(ro) =/'(jo + ^ ^y) Aj. 


Am 

Ax 


=/'(ro + 4^- 


When Ax approaches 0, the right hand side approaches a limit, 
provided that ff (y) is continuous : 



This proves the theorem under the restriction mentioned. 
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The proof given in the elementary treatment of the Calculus by 
writing 

Am __ An Ay 
Ax Ay Ax 

is not general, since Ay may vanish for values of Ax 0 in every 
neighborhood of the point Ax = 0. E'er example, 

f (j:) = c, 

where c is a constant. Here, Ay ^ 0, and so for no value of Ax 
can we divide by Ay. 

It is possible to meet the difficulty and establish the theorem 
without any restriction. Let 

Jr (Ay) = /(ro + ^r)-/(ro) ^ ^ o; 

A,y ’ 

t(o)=/(ro). 


Then the equation: 




Ay 

Ax 


is true for all values of A.r considered. Now, the function is 

continuous at the point y = 0. Hence the right hand side of this 
equation approaches a limit : 

lim <)r(Ay)-^-^ =y'(yj) {x„). 


and the proof is now complete. 

Differentials, It is to the theorem just proved that the. differ- 
entials, regarded as an aid to differentiation, owe their value. For, 
by definition, 

dy = Dxy Ax, 

when X is the independent variable. Moreover, when x is the in- 
dependent variable, we define dx as equal to Ax : 


Hence 


dx = Ax. 
dy = Dj^y dx. 


when X is the independent variable. And now, by the theorem just 
proved, it follows that this equation is true when x and y are both 
functions of* r : 


r =/w. 


X = f (t). 
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For, Dry — Dxy Dtx, 

and by definition : 

dy = Dry Af, dx = DtX At. 

§6. Taylor’s Theorem with a Remainder. Let f{x) he 
contviuous in the closed interval 

a X ^ b 

Let fix) have derivatives of the first n -f- 1 orders^ 
fix), •••, /'■«(x), 

at all interior points of the interval t a <, x <. h. Then 
fix^ + A) -/'ATo) + h/'(xu} + + ■ ■ ■ + 


+ (^n)i »<»<•. 

where Xq, Xq h are any two points of the interval. 

Tlie proof is given in the Calculus; cf. for example the Author’s 
Introduction to the Calculus^ p. 431. 

§7. Functions of Several Variables. Let 

U=f{xi, ••■,Xn) 

be a function defined in the points of an open region R in the n-dimen- 
sional space of the variables {xi^ * • • , Xn). The concepts : convergence^ 
limit, continuity have already been defined, Chap. Ill, end, Exercises 
2/8, pp. 94/95. The partial derivatives of u at the points of R are 
defined in the usual manner ; e. g. 

— Um /Ul 4 - Axi, Xo, • • •, Xn) — /Ul, X^, * - , Xn) 

If u^f{x,y\ 

we shall write the derivative in either one of the rotations: 


du 

dx 




Similarly : 

d^u 

dxdy 


or fi (x, y), etc. 




or 




etc. 
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The proof that 

dx dy dy dx 

under suitable restrictions — the existence and continuit}) of fx 
fx (^, r)t fxx jy) is sufficient — will be given in Chap. IX, § 6. 

If there is only one independent variable, n = 1, the derivative 
becomes an ordinary, or total derivative: 

du 
dt ‘ 

But it would be inconvenient to make an exception in this case, aind 
so we write 

bL 

dt 

when occasion arises. 

Law of the Mean, Let the function f (j;i, • • • , Xj^ be defined 
in the region 

'R- \x^ — a^\<Ajt, A =!,•••,«, 

and let it have partial derivatives of the first order there. Let 

\hk\ < -■^ky * = 1, • • •, n. 

Then the difference 

/(«1 + *1, • • an + kn) —/(«!, • • S an) 
can be written in the form: 

f{ai + hit a<i h^t * * *» an d" ^2 "h * * *» d" hr^ 

d " <^2 d" ^2, * * *, d" A/i) f {ait a^t a^ h^t ’ * '» d- An) 


d" f {ait • • * , ^n-1 , On d“ An) f {ait • • • , fln -1 » On)* 

Applying the law of the mean for functions of a single variable 
to each of these differences we arrive at a first form of the Law of 
the Mean for functions of several variables: 

f{ai d- hit •••,««-!- hn) — f{ait • * *, ««) 

n 

— X ■ ' ' ’ '**-1’ '** ^*+1’ ■■■><*» + A«), 

*=1 

0 < < 1 . 


1 ) 
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From this result we infer, as a first application, that if the 
partial derivatives are bounded in the point [a), the function is con- 
tinuous there. But the theorem would not be true without the 
restriction, as appears frojn the example: 

( /(^.r)= ■ .. ' (^.r) 7* (0, 0); 

2) ] + y 

C /(O, 0) = 0. 

With the aid of the Law of the Mean the theorem relating to 
Change of Variables (Theorem 1) is established, and by means of it 
in turn a more symmetric form of the Law of the Mean is obtained 
in case the partial derivatives are continuous in R, Let 

P{t) =/(«! + thi, ■ ■ ■, a„ + th„), 0 ^ f ^ 1. 

Apply the law of the mean to F {t)\ 

F(t)-F(0) = F'{^), 0 < ^ < 1. 

Hence 

5) f d" * * * » ^71 + hn) — f («i, * • *, fln) 

n 

— ^f>kfk («i + ® A], • a„ + 9 h„), 0 < 9 < 1. 

k—i 

In this form the law is easily remembered. It holds for more 
general regions. Let 5 be a region which contains in its interior 
the points of the line 

xj^ = aj^ t hk, /l = 1 , • • • , n, 0 ^ ^ 1 . 

Then the above proof applies and the theorem is true. 

Thi:()Ri:m 1. Change of Variables. Let 

« =/(ri> • • ’.yn) 

he continuous, together with its partial derivatives of the first order, 
in the neighborhood of the point {'y) = {b); i. e. B: {b^, • * *, A,). 
Let 

k = 1, • * • , n, 

he continuous, together with its partial derivatives of the first order, 
in the neighborhood of the point (x) = (a); and let 

Vk ’ * *’ ~ /l = 1, • * • . /I. 

Ut 




k= \, • *, w, 
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he substituted in the function f • • • , y-f^^ u thus becoming a 
function q/ Xm)» Then 

4 \ 1}L = A!L hi. 4 - . . . + hs. 

Bxr dy\ dxr dy^ dxr 

It is of fundamental importance to observe, in this last formula, 
what the uidependent variables are. There are two classes : 

Class A, the (jr^, ' • *, :r,„) ; 

Clasg B, the {yi, • ■ - 

Those partial derivatives in which an Xr appears below the line, assume 
a function of the variables of Class A ; those in which a y^ appears 
below the line, assume a function of the variables of Class B, 

The student will do well to illumine this last formula, writing 
each Xr^ say, in red ink, and each yj in blue. 

For the proof of the theorem the student is referred to treatises 
on the Calculus; cf. e. g. the Author’s Advanced, Calculus, Chap. V. 
Differentials, Let 

U '--.Xn) 

be defined in the above region R and possess partial derivatives of 
the first order there. Let (:r) and {x + Ax) = {xi + Axi, • • • , 
Xn -h Ax„) be any two points of the region. Then 

Am =/(xi + Axj, • • •, x„ + Ax„) — /(xi, • • •, x„) 

can be written by the Law of the Mean, 1), in the form : 

5) Am Axi -f • • ' + 

where fj^ denotes the value of f^ formed for the mean point of that 
formula. 

If, in particular, the derivatives fj^ (xj, • • • , Xn) are continuous 
in R, set 

fk =/* + Ca, ^ = 1 , • • •, 7Z, 

where fj^ is formed for the point (x). Thus 

6) Am = Axi + • • • + Axn 

Bxi 

+ Axi + • • • + Cn Ax„. 

The first line on the right is called the principal part of the 
infinitesimal Am and is defined as the differential of m: 
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7 ) 


I * I 1 A 

«“ = ^ — A.ri + • • • + — Ax„. 


The differential of each of the independent variables xj^ is defined 
as the increment, 

dx]^ = ^Xj ^ , A: = 1, • • • , «. 

Thus 7) becomes: 


8 ) 


du = dxi H h 

UX^ U Xji 


And now the fundamental theorem about differentials is, that 8) is 
true^ no matter what the independent variables may be. 

More explicitly, consider the change of variables defined above, 
the notation being that of I’heorem 1. Then 


9 ) 



the y(x being the independent variables. Secondly, 

10 ) dy,=%llidXr, 

r=i 


the Xr being the independent variables. Now, when the Xr are the 
independent variables, 


11 ) 


m ^ 

du:=^y -p- dXr 


By Theorem 1, 




dXr 


r==l 0=1 


p. p^dXr. 

dya, dXr 


The left-hand side of this equation is equal to du as given by 11). 
The right-hand side is equal, by virtue of 10), to du as given by 
9). Hence 9) is true, regardless of whether the independent variables 
are those of Class A or Class B, and that is what we set out to 
prove. The result can be stated as 

Theorem 2. Differentials. Let 


u=fiyu ■••<yn) 

and let a change of variables: 

= •••» ^rn)y 


A == 1, * • *, niy 
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be made under the conditions stated above. Then 

J2) * = 

regardless of whether the independent variables are those of Class A 
or Class B, 

Remark, Since the differentials of' the independent variables by 
definition are the same as the increments, they are arbitrary. Hence 
an equation : 

Ai dzi H \r Ap dzp = dz^ + ^ ‘ + Bp dzp, 

where Zj, • • • , are the independent variables and Aol, Ba are any 

functions of (z^, • • • , Zp), leads to the inference that 

Aa== Ba, cc = 1, • • 

§8. Integral of a Continuous Function. hetf{x) be a 
function, continuous in the closed interval 

a ^ X ^ b, 

iVIark the points x^p/2^, where n is a natural number and p^O, 
±1, dt 2, For a fixed n, those points which lie within the 

interval shall be denoted by : 

< Xi <, X2* • • <. Xi <, b. 

Furthermore, set 

Xq^ a, b^ z-v+i; 

— A‘ = 0, 1, - i/; = 2 

Let x]f^ be any point of the interval («, b)^ which lies in the closed 
interval : 

Xf, ^ x!, ^ 

Form the sum;* 

k^P 

where p is either of the numbers 0, 1 ; and <7 is v — 1 or v. When 
n becomes infinite, the sum 5 approaches a limit, J, and I is defined 
to be the value of the definite integral 

♦ When there is no point of division within the interval, S still is defined 
if p ar 0, q am 1, FoT Other values of p, 9 let 5 av 0. 
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b 

// 


{x) dx. 


or 


f fix) dx = lim ^ / (xl) Ax*. 


To prove the convergence we proceed as follows. Let Mj^y mj^ 
be the maximum and the 
minimum values oif{x) 
in the closed interval 
{xj^y ^A+i). Assume first Mk\ 

that f{x) >0 and let M% 
m be the maximum and - 
the minimum of f{x) in ^ 

{ay b): 


•Ti 

-H — 






Form the sum : 


m ^ f{x) ^ M. 

T'n= X iW*Ax*. 

A=0 

As n increases, decreases or remains unchanged : 

Tn ^ Tn^i. 

But 

Tn ^ 5 ^, m^xjf ^ m{b — a). 
jSi 

Hence Tn approaches a limit, Chap. 11, § 5 : 

lim Tn = Ii- 


Similarly, the sum 

v-l 

A=»l 

increases with n, or remains constant : 

tn S tn-^i ; 

tn S Axj^ ^ M{b-‘ a)r 


and 


Hence tn approaches a limit: 


lim tn = I^- 


-Ty b rv4-t 

_l 1 i— 
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Moreover, 
and hence 
Finally, 

For, 


— Tjt’, 
lo ^ /i. 
/2 = /l. 


v-l 


— ?„ = X — m*) At* + Mo Aaro + Mv Aar^. 

4 =1 

Since f{x), being continuous in the closed interval {a,b), is 
unifonnly continuous, Chap. Ill, § 10, it follows that, to a positive 
€ chosen at pleasure, there corresponds a positive S such that 

\x--x^\<. S, x,x' in (a,b). 


If, then, = 2 " is less than (J, the first sum is less than 
^(b — a). Hence 


Now 
and so 
Hence 


Tn-tn < €{b-a)^2M 

-^1 = » -fo* 

0 ^ Ii-l2< ^{b-a)-^2xM 2-\ 
7, = 72, 


Turning now to the sum 5 we see that 

v-l q V 

X "** = X = X 

k~ l k^p k 0 

Since each of the extreme sums approaches the common limit 
7i = 72 — 7, it follows that the sum 5* approaches this same limit. 

It remains to remove the restriction f {x) > 0. Let C be a 
constant such that the function 


ip{x) ^f{x) + C 

is positive in {a,b). Form the sums: 
q q 

X ^ = X + C (o:^ - Xj,). 

k=p k=p 


The sum on the left converges when n becomes infinite, as has just 
been shown. The last term on the right approaches a limit. Hence 
the sum 5 coverges here, also. 
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From the method employed in formulating this existence theorem 
follow at once two corollaries. 

CoROLi-AKY 1. Law of the Mean : 

b 


J f {x)dx = {b - a) f {X), 


a < X < b. 


a 


For, obviously : 

h 

{h — a) m ^ J f{x)dx g {b-a)M, 


the lower signs holding only when f {x) = const. = m = M, If we set 


then 


J f{x)dx = {b- a)Y, 

a 

m < r < M 


unless y* (x) is a constant. Hence the function 

which is continuous in the closed interval (a, changes sign there, 
and so has a root, x = X, within the interval, Chap. Ill, § 9, 
Theorem 2. — In the excepted caise, X may have any value within 
the interval. 


Coroli.arv 2. If a < c < b, then 


h c 

f f{x)dx = f fix) dx + 

a a 



dx. 


The proof is immediate, thanks to the formulation of the exist- 
ence theorem, and may be left to the student. 

We are now in a position to prove the following 
Convergence Theorem. Let f{x) be continuous in the closed 
interval {a, b). Let the interval be divided in any manner into n 
subintervals by the points 


a < Xi <•** < Xn~.\ < b. 


and let Xq S b ^ Xn; let 

= *i+i a:* ^ 4 = 4 in (<*. *)• 
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Then the sum 

k=p 

where jt? = 0 or 1 and q ^ n — 2 or n — 1, approaches a limit for 
CO, provided the longest approaches 0. 

The value of this limit is the value of the definite integral: 

lim X /(^i) = / /(^) 


Proof. Consider first the case: Xq — a, Xn = h, p = 0, q n — 1. 
The general case then follows at once. By Corollaries 2 and 1, 




Hence 


C fix) dx = '^ C fix) dx='^ /(A'i) Axk, 

A=0 ^ At=0 

< Xk < xk+i- 

f fix) dx— y /(x 4 )Ax= ^ [fiXk)-fixk)] Ax*. 


Since f{x) is continuous in the closed interval {a, h), it is uni- 
formly continuous, and so 


Thus 


\fiXk)-fix'k)\ < €, |Ax*|<<r. 





< € (i — a), 


and the theorem is proved. 

On the basis of the Convergence Theorem one may define the 
definite integral as the limit of the more general sum which appears 
in this theorem. In any case, the definite integral is the mark-. 

h 

f fix)dx. 
a 

Its value is the limit approached by the sum in question, and this 
number is represented by the same mark. 



DERIVATIVES. lOTEGRALS. IMPLICIT FUNCTIONS 115 


Extetuwn of the Definition. b <. the definite integral 
shall be defined as follows: 




dx. 


\{ a S c ^ h, then, by definition: 

c 

j* fix) dx = 0. 

c 


Hitherto we have considered only functions f (:r) defined in every 
point of a closed interval. We now extend the definition to the case 
that, in a finite number of points, the function is not defined or 
discontinuous ; being continuous, however, in all other points, and 
bounded in the interval. In particular, the interval may be open at 
one or at both ends, as 

a <. X <. b ; 

but it must be bounded. The above definition of the definite in- 
tegral, and the Convergence Theorem, apply to such functions, with 
the obvious modification that no xj^ can be chosen at a point where 
fix) is not defined, and that a maximum (minimum) may have to 
be replaced by an upper (lower) limit. 

Indefinite Integral. Let fix) be continuous in the open or 
closed interval ia, b) and let F ix) be a function whose derivative is 
equal to f ix ) : 

F^ix)=fix). 

I'hen Fix) is called the indefinite integral oi f ix). 

One such function is 

X 

F{x) = Jf{t)dt. 

a 


For, by the Law of the Mean . 


Fix + Aar) — Fix) ==^ fit)dt = Ax fix + OAx), 

X 
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The most general function is (Chap. IV, § 4) : 

X 

F(x)= Jf{t)dt + C. 

a 

Exerctsks 

Let the functions f (:r), <p {x)^ etc. be defined in the closed in- 
terval a ^ X with the possible exception of a finite number 

of points. Let them be continuous except at most for a finite number 
of points, at each of which the function may or may not be defined. 
And let the functions be bounded in the interval. 

Prove the following theorems : 


1 ) 


^ cf (x) dx = c f [x) dx, 


where c is a constant. 
h 


2 ) 


5) 


4) 


J* [f ix) + <P\x)'\dx — J* fix) dx + <p{x)dx. 

a a 

h h 

\J*fix)dx ^ J* \f{x)\dx, 

I a a 

h h h 

^[fi3:) + ip{x)]dx ^ J‘ \f{x)\dx+ J* \fp{x)\dx. 


)dt 


5) F{x)= 

a 

is continuous, a S x b. 

X 

6) ~ J* fit)dt =f{x), 

a 

provided f{t) is continuous at ^ = a:. 


7) 


If 

J fix) dx =fib) -fia), 
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provided ( j:) is a function belonging to the class here considered, 
and f (x) is continuous, a ^ x ^ h, 

8) J fix) (x) dx —fix) (fix) " J <P 

a a a 

provided f' ix), ix) belong to the class of functions here considered, 
dCDAfix)^ix) is continuous, a ^ x ^ b. 

Obtain a generadization of 8) for certain discontinuous functions. 
Suggestion ; 

h £*+l » 

9) f J (x) <p' (x) dx = <P (x) —f^{x) f ix) dx. 

“ * n “ 

§9. Implicit Functions. In the Calculus we leam how to 
differentiate an implicit function. Thus if 


1 ) 


Fix, J, z) = 0, 


dz Fjg dz Fy 

^ dx Fz ' By ^ Fz ' 

But how do we know that Equation 1) has a solution; i.e. defines a 
function? If, for example, 

F iu, x) = x^, 

the equation 

Fiu,x)=^0 

is true for a: = 0, u = 0; but for no other value of x does it have 
a root. 

Again, if 

F iu, x) = — 3^, 

then the equation 

F iu, x) = 0 

is satisfied by the two single-valued functions; 


u — x, M = — x; 

and in the neighborhood of the origin both functions must be retained, 
to give the complete solution. So, even when the equation 

FiUyX) — 0 

has a solution, there is no guarantee that the solution will be given 
by a single-valued function. 
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When I was a student, I learned in Williamson’s Differential 
Calculus (the best seller of that day) that the envelope of a family 
of curves, 

/(x, jr, <t) = 0, 

is found by differentiating partially with respect to a : 



and then eliminating a between the two equations. Thus the family 
of circles ; 

(x — a)^ 4 - — ^2 

have an envelope obtained by differentiating partially : 

— 2 (x — a) = 0, 

and then eliminating a : 

_ ^2 
or 

But I wondered what would happen if the equation of the family 
were thrown into the equivalent form : 

<p{x,y) = a.-, 

or in the case of the example : 

X — a = ± i/ 

The rule led to 1=0, and that did not seem quite right ; but 
it did not disturb Williamson, if indeed he had ever thought of 
it. Youth is iconoclastic, and the Method of Envelopes was one of 
the Articles of Faith, in those days, to which I could not sub- 
scribe. 

The reader will have gathered from these remarks that there is 
real need of an answer to the question : When does the equation 

F(m,x) = 0 
or 

F{u,Xi, •••,Xn) = 0 

define a function of x or x^, — , Xn? We proceed to the answer. 
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§10. The Existence Theorem.* Let 

1) F{u,x,y,--) 

be a single- valued, continuous function in the neighborhood {A) of 
the point (mq, Xq, jtq, • • •) : 

\u — uq \ < A, \x — xq \ < A, \y — yol < A, - 0 < A; 

and let 

2 ) F{u^,XQ,yQ, ‘ = 0 . 

Let F{u,x,y,'-‘) possess first partial derivatives, and let 
them be continuous, in the above region (A). 

Finally, let 

P ( 

- 5 — —Fu{uo,Xo,Xo<---) 7 ^ 0 . 

OU 1 ( 0 ) 

Then^the equation: 

3) F{u,x,y,'-‘) = 0 

has the following solution in a certain neighborhood of the point 

(uo.^o.ro. •••)••— 

There exists a function, 

4) u — <p{x,y,’'-), 
single-valued and continuous in a region 

\ X — xq \ < h, \ y — y^l < h, • • • , 0 < h ^ A, 

and having the properties: 

a) ?>(a:o.Jo. •••) = «o> \ip{x,y,---)\<A; 

b) When <p is substituted for u in F, this function vanishes 
identically : 

5) Fl<p{x,y, x,y, •■•] = 0; 

c) The only roots {u, x, y, • • •) of Equation 5) which lie in 
the region 

\u — Uq\<A\ \x — Xq \ < h, I y — Jo 1 < “ 

where 0 < A, are those for which 

6) u = f •••)• 

• The first proof of the theorem, under narrower hypotheses, is due to 
Cauchy, Turin Memoir of 1851; cf. Exercices analyse vol. 2 (1841) p. 65. 
In its present formulation the proof was given by Dini, Analisi infinitesimaie 
voL 1 (1877/78) p. 162. 
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Finally, the function <p{x, y, • • • ) has continuous derivatives of 
the first order given by the rule of the Calculus. 

Proof. We will begin with the case that [x, y^ •••) reduce to 
a single variable x ; 

7) ^ F{u,x). 

Here, wi^ can follow each step by a geometric representation. 
The region {A) is interpreted by the interior of a square with its 
vertices in the four points (wq "he. A, Xq ’±. A). Let 

0 < Fu{uq.xq). 

Since Fu [u, x) is continuous, it is possible to find a subregion {A*) : 

\u-u^\ ^ A\ \x-x^ \ ^ A^, 0 < A' < A, 

in which 

8) 0 < Fu{n,x). 

And now consider the func- 
tion 7) along the line x = Xq: 

9) F\u,Xq). 

This is a function of the single 
argument, u, which vanishes for 
u = and has a positive deriva- 
tive when 

Uq-- A' < u < Wo + 

Hence 

10) 0 < F{uq + A\xq), F{uo — A\xq) < 0. 

Secondly, consider the function x : 

F (uq + A\ x). 

For X = Xq it is positive, and since it is continuous, it must remain 
positive in a certain neighborhood of this point : 

11) 0 < F(uo -b A\x) 

when 

^0 — ^ tc ^0 "h 0 <C Aj ^ A\ 

Similarly, 

12) F{uq — A', x) < 0 

when Xq — h 2 < ^ < Xq ho, 0 < ho A'. 

Let h denote the smaller of the two numbers hi, ho. 
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It is now easy to give the proof of the existence of a solution of 
the equation 

13) F{u,x) = 0, 

for which — h<^x<.x^-\‘h and — A' < u < Mq 4- A'. 
Let X = a/ he chosen arbitrarily in the interval 

14) xo — h < X < Xq + h. 

Consider the function F{u,x) for this value: 

F{u, x'). 

We have here a function of the single variable u : 

Uq — ^ u ^ Uq + A\ 

which is negative when u — Uq-^A^ and is positive for u ~ Uq + A\ 
Since it is continuous, it must vanish in this interval. Moreover, it 
cannot vanish but once. For, if it had two roots, m' < w", then by 
Rolle’s Theorem 

Fu{U,x^) = 0, u' < U < w". 

But this is in contradiction of 8). 

We have thus established the existence of a root u of Equation 
13) for each of the interval 14), and 

Uq — A' < u < Wq + A' 

Moreover, we have shown that there is only one such root. Thus 
we are led to a function 

15) M = ^(x), 

defined in the interval 14), single- valued, and such that 

16) Uq — A' < ip {x) < uq + A\ 

And this function satisfies Equation 13). 

This completes the proof of the Existence Theorem. It remains 
to establish the continuity of (p (x) and the existence of a derivative. 

The next step, then, consists in showing that ip (x) is continuous. 
First, it surely is continuous at the point x = Xq : 

1 f Uo) 1 < €, I x - xo I < <y. 

•For A^ can be chosen as small as we wish and hence, if € is less 
than the above A\ a new ^4' = € can be selected. 
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Secondly, let jr' be an arbitrary value of x in 14), and let 
:= (p (x'). Tnen all of the hypotheses of the Existence Theorem 
are fulfilled in the neighborhood of the point {u\ x^). In particular, 
then, the solution must be continuous at the one point, x = x^. But 
the solution is unique, and so coincides with the function 15) near 
this point. This completes the proof of continuity of the function 
<p (x). 

Remark. Up to the present we have made no use of the hy^ 
pothesis of the existence of the partial derivative dF/dx\ nor have 
we used the continuity of dF/du^ except to justify 8). It is enough, 
then, to assume the existence of this latter derivative, and the 
inequality 8). 

Differentiation. The proof of the existence of a derivative of 
the function <p (x) is the same as is given in the Calculus. It is 
enough to consider the point x = jtq. We have, by the Law of the 
Mean : 

F {uq + Aw, 4* Ax) = Aw Fu (wq + 0Aw, 4- 0Ax) 

4- Ax Fx {uq 4- ^Aw, Xq 4* ^Ax) = 0, 

Aw __ ___ Fx (wq 4- xq 4- O^x) 

Ax Fu (wq 4- 0Aw, Xq 4- 0Ax) * 

The division is possible for values of Ax suitably restricted, since 
the corresponding values of Aw are also numerically small, and 
Fu (w, x) is continuous and different from 0 at (wq, Xq). Hence 

liin ^o) . 

Ax Fu(Uo, Xq) 

Exercises 

1. Carry through the proof in the next case, 

F (w, X, y) = 0. 

First, write out the theorem in detail for this case. Illustrate the 
region {A) by a cube with its vertices in the eight points (wq ± 

Xq dz Ay yo dt A). Draw the space figure with ruler and pencil or 
pen. Draw in the smaller cube ( F) in less prominent lines. Then 
put in the region 

I u — «o I ^ 1 X — Xo I < A, i — Jo I < A 



DERIVATIVES. INIEGRAI^. IMPLICIT FUNCTIONS 123 


in red pencil or ink, or other colored lines that will make it stand 
out. 

2. Insert at each point of the proof carried through in the text 
a precise reference to the theorem used, and make a list of all such 
theorems, which have been illustrated by the present applications. 

3. Show that the equation 

2u + e = cos (r — jy + w) 

defines a single- valued function 

u~<p{x, y), 

continuous for all values of the arguments, x and y. 

4. Give an analytic proof of the theorem in the general case, 
observing the geometric significance of each step in space of n 
dimensions. 

5. Assuming that the function F{u, x, y, • • •) has continuous 
derivatives of the second order, and satisfies the other conditions of 
the theorem, prove that the function fp{xy y^ • • • ) has continuous 
derivatives of the second order. Generalize. 

6. Show that, under the conditions of the theorem, there exists 

a subregion , 

R: \ u Uq \ ^ I — jTq i ^ 

and a positive constant h' such that, if 

F(« 1 , Ti) = 0, (uj, Xi) in R, 

the equation 

F{uj x) = 0 

admits a solution 

M =5P(X; Xj) 

defined throughout the interval 

— h' < X - Xi < h', 

and having the properties of the function (p{x) of the theorem. 

§11. Simultaneous Systems of Equations. Let 

1) Fi (iq, - Up; xi, • • • , Xn\ i — 1, • • • , 

together with its first partial derivatives, be continuous in the 
neighborhood of the point (&i, •••, bp; ai, • • •, an) and vanish there: 

F i * * * * * * * * a-fi) 0, i 1, ’ * * , p» 
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Let the Jacobian, 

lEl ...111 

dui dup 



dFp dFp 

du^ dup 

be different from 0 there: 

J{bi, ' -,bp , ai,- *, an) ^ 0. 

Then there exist p functions: 

5) Ui = ffi Ui, • • •, Xn), I = 1, • • •, p, 

continuous in the neighborhood of the point {a^, • • •, Un) and taking 
on the value bi there : 

bi = (piiai, •••, an)y i= 1, p; 

and such that, when substituted in the functions Fi, they cause 
these to vanish identically: 

• •-y’/.Ul.- • • -.Xn] ^ 0, 1 = 1,- -.p. 

Furthermore, the only roots of the simultaneous system of 
equations 

4) Fi (mi, - ',Up \ xi,- ',Xn) — ^, i—\,--,p, 

which lie in the neighborhood of (Jb\, ' ' ' ,bp', a^^ are those 

given by Equation 5). 

Finally, the functions ifi {xi, • * • , .r„) possess continuous deriva- 
tives of the first order, given by the ordinary rules of the Calcidus, 

Consider the simplest case : ;? = 2, « = 1 : 

5) F {u, V, x) = 0, $ (u, r, x) = 0 ; 

dF dF^ 

du dv 

du dv 

and denote the point by {uq, Vq, Xq). We wish to show that the 
simultaneous solutions of Eqs. 5), which lie in the neighborhood of 
this point, are given by two functions, 

6) u = y’(x), 



^ 0 , 
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each continuous in the neighborhood of x = a:Q and taking on the 
respective values Uq, Vq in this point. 

The functions Fu and Fv cannot both vanish in the point 
(uq, Vq, Xq), for otherwise J would vanish there. Let 

7) Fu{ua,Va,Xo) ^ 0. 

Then the equation 

8) F {u, v,x) = 0 

can be solved for u by the Existence Theorem of § 10 : 

9) M = CO {v, x ) , 

and moreover all the roots of 8) which lie in this neighborhood are 
given by 9). I’hus Equation 9) is equivalent to the first equation 5) 
in the sense that the two equations : 

F (u,V,x) W = 03 (r, x) 

have the same roots in the neighborhood of {uq, Vq, Xq). 

From this fact it appears that the roots of the simultaneous 
system 5) coincide with the roots of the simultaneous system : 

10 ) u = c£i{v,x), ^{u,v,x) = 0. 

A necessary condition for such a root is that 

11) $ [ CO (t7, ^), v, arj = 0. 

And conversely, any root (v, x) of 11), lying in a suitable neighbor- 
hood of {vq, Xq), will lead to a value of u through 9), lying in the 
neighborhood of w = Uq, the tripel (uq, Vq, Xq) being a root of 5). 

It remains, then, to solve Equation 11). Let 


G(v, x)^^[ CO (v, x), V, X ]. 


Then 


From 8) 

dco Fv 

dv Fu' 

and hence 


Thus 
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(^v (Vq, JTq) = 


J (zZq, Vq, X^) 
Fu (wol ^^0' ^o) 


^ 0, 


and moreover G {v^ x) is seen to fulfil all the other conditions of the 
Existence Theorem of § 10. Hence Equation 11) is equivalent to the 
equation 

V \jr (x). 


where \l^(x) is a function continuous in the neighborhood of the 
point X — Xq and taking on the value Vq there. Let 


^ (jc) = 05 [ ^ (x), X ] . 

Then the functions 

u = ^ {x), i; = vly (x) 


fulfill all the conditions of the Existence Theorem we set out to 
prove. 

The extension of the proof to the case p == 2, n = n requires 
no modification. When /? !> 2, the method of mathematical induction 
can be used. The partial derivatives of Fi cannot all be 0. Let 


dF^ 

dui 


^ 0 . 


Then the equation 

Fi(«i, • • •, Up; OTj, = 0 


can be solved for Wj : 

12) Mj = 0 ) («2, • • •, M;, ; Xj, • • •, x„). 


This equation, combined with the last — 1 equations 4), is equi- 
valent to the original system 4). And now a necessary condition for 
a simultaneous solution of 4) is, that Up \ arj, • • • , Xn) be a 

solution of the — 1 equations: 

13) Fi [ 0 } (ii 2 , Up; xi, •••, x„), U 2 , Up; Xj, • • • , x„ ] = 0, 

i 

The Jacobian of this system is seen to have the value 


J 

dFi/dui 

and so does not vanish at the point hp; • • • , «„). Thus 

all the conditions of the Existence Theorem before us are seen to be 
fulfilled for the system of yt? — 1 equations 15). 
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Conversely, any solution of 15), suitably restricted as to neigh- 
borhood, leads through 12) to a solution of the original system 4), 
and this completes the proof. 

Remark. In the foregoing proof we have made no use of the 
derivatives dFi/dxj. Hence these need not exist. They are not 
needed till the next step. 

Differentiation. Returning to the case = 2, n = 1 we can 
prove the existence of derivatives as follows. Let 

Au = <p {xo + Ax) — <p (xq), Av = (xo + A:r) — 

From the law of the mean, 

F{uq -f Aw, Vq + Av, Xq + Ax) = Au Fu -I- Av Fv -b A:r Fg = 0, 
^ (wq -h Aw, Vq 4- Av, Xq 4- A:r) = Aw + Av 4- Ax = 0, 

where Fu, * * * , ’ * * are formed for mean values of the argu- 

ments, as 

FuiuQ 4- OAu, Vq 4- BAv, Xq + BAx), etc. 

Since J {uq. Vq, Xq) ^ 0, it follows that 

Fu F, I 
K 1 ’ 

formed for these values, will not vanish if A.r is suitably restricted. 
Hence 


Aw _ 


Av __ 

Fu F, 

Ax 

Fu Fv \ 

’ Ax ~~ 

Fu Fv 

1 

1 




formed for the above mean values. It is obvious that the right-hand 
sides approach limits as Ax approaches 0, and hence <p (x), \J/ {x) 
possess derivatives given by the ordinary rules of the Calculus. 

§12, The Inverse of a Transformation. Let a tramfor- 
mation be given: 

1 ) yi — 1 = 1 , 

where ft , • • • , Xn), together with its derivatives of the first 
order, is single-valued and continuous in the neighborhood of the 
point (wj, • ' • , Un), and let 

bi = fi (wi, • • • , an), £ = 1, • • • , 71, 
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Let the Jacobian: 

2^ g(ri. •••.■Tn) 

dixi, 

be different from 0 in this point. Then the equations 1) admit a 
solution of the form: 

5) Xi = ifi • • •. yn\ i 1, • • •, n, 

where * • * , yn) is single-valued and continuous in the neigh- 

borhood of the point {bi, • • •, having continuous derivatives of 
the first order with non-vanishing Jacobian. 

For, form the equations : 

^ i (-^1* ' * ‘ t Xn \ yi<t • • • , jy*7i) ^ fi (jTj, • • • , yi ^ 

i = 1, • • n. 

Identify these functions Fi with the Fi of the theorem of § 10, 
where p ^ n, where Ui is replaced by xu and where the former Xi is 
replaced by yi. Then all the hypotheses of the former theorem are 
fulfilled, and the conclusion is a proof of the theorem in hand. 

In case the Jacobian 2) vanishes, a single-valued continuous 
inverse 3) may still be possible ; witness the example ; 

y = X — y^ . 

But the derivatives of the inverse functions ip cannot be continuous. 
For it is a property of Jacobians that* 

d (U|, -',Un) _ djui, - Un) djyi, • - , Tn) 

d{yi. • yn) ^{xu 

and hence, in particular, in the case of the transformation 1) : 

Sjyu * ^ '^yn) ^{xu ' - % X„) _ ^ 

Xn) d{yi, • • •, yn) 

If, however, the Jacobian 2) vanishes identically, a single-valued 
inverse is never possible ; cf. § 13. 

§13. Identical Vanishing of the Jacobian. Let f{u,v), 
ip {u,v) be two functions which, together with their first derivatives, 
are continuous in the neighborhood of a point (mq, Vq\ and let their 
Jacobian vanish identically : 


• Cf. Jordan, Cours d*analjrse^ vol 1 (1893) p. 89. 
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1) 


0 . 

d{uy v) 


Then f and ip are connected by a functional relation : 


2) Q [/ (u, v), f {u, t>) ] = 0. 
For, let 

3) x=f(uyv)^ y =■ ip{u^v). 


If fuy fv both vanish identically, then f (w, v) = const, and we are 
through. Assume, then, that 


^=/„(u, v) ^ 0. 


Let (wi, Vi) be a point of the above neighborhood, in which 

4) /u(wi.Vi) 0. 

Then it is possible to solve the first of the equations 3) for u in the 
neighborhood of this point : 

5) w = CD (r, x). 


Let us substitute this value in the second equation 3) : 

6) ^ ~ ^ [ CD (v, o:), V ]. 


The function on the right does not depend on v: 


7 ) 

For, 


dy 

dv 


= 0. 


dip[oi {v, x)^x] __ ^ d(D 


dv 


dv 


+ 


dco _ fv 

dv ~ /„ ’ 

and from 1) it follows that 7) is true. Thus 

y [x) 

is true for all values of x and y given by 3), or 
tp {u, v) s [/ (m, v ) ], 

and that is what we set out to prove. The generalization is im- 
mediate : — 
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Theorem. Let 

8) fi {ui, Up; Xi, • • Xn), I = 1 , • • s p, 

be continuous, together with their first derivatives with respect to 
Wi, * * * , Up, in the neighborhood of a point {bi, • • • , hp \ fiT;, • • • , Un), 
and let the Jacobian 


9) 


g(/i. •••./;>) 

d{ui, ' ‘ Up') 


= 0 


in all p n arguments. Then these p functions are connected by 
an identical relation of the form: 


10) Q (/i, •••,/;,) ^0. 

More precisely, let 

yi —fi{u,x), i=\,- - ,p. 


Ci =fi{b, a). 

Let {y, a!) be a suitably chosen point of the above neighborhood, 
arbitrarily near to {b, a) and let 

Then there exists a function O (j'j, • • • , continuous tO' 

gether with its first derivatives in the neighborhood of the point 
(^) r= (c') and vanishing there, but having at least one first de- 
rivative different from 0 there, and such that 10) is true for 
all {u, x) in the neighborhood of (JJ , a')- 

Although {y, u) can be taken arbitrarily near to {b, a) there is 
no reason to assume that it can be made to coincide with this point. 
Certainly, in the corresponding case of analytic functions of several 
complex variables, this is not true.* 

A generalization of the foregoing theorem for the case that the 
matrix of the determinant of the Jacobian 9) is of order less than 
p — 1 is given in the Funktionentheorie, 1. c. § 23. 

14. Solutions in the Large. The theorems of §§ 10-13 
relate to solutions in a restricted region, the extent of which is not 
given explicitly at the outset, but is contained implicitly in the 
hypotheses of the theoreiiis. Thus the results hold in the small (im 


• Cf. Osgood, Funktionentheifrie IIi Chap. 2, § 22. 
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Kleinen). There are no general methods for dealing with these ques- 
tions in preassigned regions; i. e. in the large (im Grossen). Never- 
theless there is a certain class of cases in which theorems in the 
small, when supplemented by unifonn properties and the covering 
theorem of Chap. Ill, § 11, do lead to results in the large. 

Consider, for example, the theorem of § 10. Let us add to the 
hypotheses the requirement that 


1 ) 


0 



in {A). Consider a subregion 

{A^) 1 w — iZo I ^ y/', \ X — Xq\ ^ A', 0 <. A^ < A. 


Let be any interior point of (A^). Then there passes through 

a solution of the equation 

2) F (iz, x) = 0, 
namely, 

3) u = ^ (x), 

where the curve represented by 3) meets the boundary of {A') in 
two points, the function $ (r) being single- 
valued and continuous in a certain interval 

^ X £ i. 

where 

xq — A' ^ £i < £2 ^ ^0 + A'. 

There are obviously eight possibilities illus- 
trated in the accompanying diagram. 

The proof is as follows. According to § 10, Ex. 6 there exists 
a positive constant /zj such that, if (zz^, x^) is a root of 2) lying in 
(A^), then a solution of 2) is given by the equation 

4) M = ^ (x) 



where Xj — hi ^ x ^ Xi + hi. 

Thus starting with an arbitrary root (zzj, 0 : 1 ) of 2), which lies inside 
of {A^), we can proceed a distance of hi forward, and also a distance 
of hi backward. If the curve 4) still lies within (/4'), we can now 
apply the equation 4) to an end-point of the arc already obtained, 
thus continuing the function ip (x), and then repeat the process. Since 
w^e make progress each time by a distanc.e hi along the axis of x, 
after a finite number of steps we must reach the boundaiy of {A^). 




Chapter V 

Uniform Convergence 

§1. Series of Functions. Consider a series of functions; 

1) Hi (x) Uo {sc) • • • 

Let each term be continuous in the closed interval 

a ^ X ^ b, 

and let the series converge in each point of the interval. Denote the 
value of the series by f ( r) ; then 

2) /(-r) = Hi (x) + U 2 (x) + • • • 

It is natural to think of the limiting function as continuous — 
partly from experience, for the power series we have met in the 
Calculus and used lor computation, represent continuous functions; 
partly because the approximation curves, 

3) r = (x), 

where 

4) S„ (x) = Ml (i ) + ; • • + M„ (x), 

are all continuous and so wotild seem necessarily to approach the 
limiting function 

5) r=/(x) 

in the manner indicated in the figure. 



More fully analyzed this assumption consists of two parts : — first, 
that the limiting locus is a continuous curve; and secondly that, if 
this curve be embedded in ever so thin a strip, all the later approxi- 
mation curves will cx>me to lie within this strip. 

Both parts of this assumption, however, are wrong, as is shown 
by the following examples. ♦ 
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Example 1. Let Sn{x) be defined as suggested by the accom- 
panying figure, namely* 



72=^ 


Thus we have an example of a convergent series of continuous 
functions which converges toward a discontinuous function, 

/W =0, 0 < ^ 1 ; 

/( 0 ) = 1 . 

Example 2. Let Sn{x) be defined as suggested by this figure: 

Sn{x)=2nx, 0 £ X g ; 

2n 

Sn (x) = 2 — 2nx, -^ < a: = — 

2n n 

W = 0, ^ < x ^ 1. 

n 

Here, 

iim Sn{x) = 0, 0 ^ a: ^ 1, 

n==» 

and the limiting function, 

fix) = 0, 0 ^ X £ 

is continuous. We have, then, it is true, a convergent series of con- 
tinuous functions representing a continuous function. But the con- 

• We point out again that not only does an infinite series determine tiie 
sum of its first n terms, but conversely any variable sn has corresponding to 
it an infinite series for which it is the sum of the first n terms; namely, the 
series: 

^2 ~ ^2 * ’ ’» l^n ^ !• 

It is, therefore, immaterial whether we think of the series as given by the 
Un or the Sn* 
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vergence is not like that represented in the figure of p. 132. If a 
small strip be constructed about the limiting locus, 
y =fix) =: 0, 0 ^ X 1, 

the later approximation curves, no matter how great n, will fail to 
remain within this strip. 

If, then, we wish to secure the kind of convergence suggested 
by the figure of p. 132, a further restriction is needed, and this 
leads us to uniform convergence, defined in the next paragraph. 

§2. Uniform Convergence. Defuiition. Let 

1) III (.r) lu (x) -f • • • 

be a series whose terms are defined in the points of an arbitrary 
infinite point set, A. The series is said to converge uniformly if, 
to a positive number € chosen at pleasure there corresponds a natural 
number, m, independent of x, such that 

1 Srtt {jc) — Sn {x) ] < €, m ^ u, n'. 

Here, 

Sn (x) = Uiix) A “ * A Un {x), 
and X is any point in A- 

Two consequences of the definition are expressed in the follow- 
ing theorems. "T he property of a series embodied in either theorem 
might have been chosen as the definition, and then the other 
theorem, and the definihon actually laid down, would form the two 
complementary theorems. 

Thkorkm 1. A necessary and sufficient condition for the 
uniform convergence of the series 1) w that, to a positive number 
€ chosen at pleasure, there correspond a natural number m, inde- 
pendent of X, such that 

I Sm {x) | <C €, ^ = 1, 2, 3, • * • , 

If the series 1) converges, let the remainder be denoted by r„(x): 

2 ) fix) = Snix) + rnix). 

Tuf.okem 2. A necessary condition for the uniform convergence 
of the series 1) is that, to a positive number € chosen at pleasure, 
there correspond a natural number m, independent of x, such that 

1 r„ (j:) 1 < €, wi S n. 
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If the series 1) converges^ then this condition is conversely 
sufficient. 

The proofs of these theorems are immediate, since the student is 
now thoroughly familiar with what is meat by a necessary condition, 
and what is meant by a sufficient condition. 

Example. The geometric series 

1) 1 + X + + • •• 

converges uniformly in any interval {a, h) which together with its 
end points lies within the interval (— 1, 1): 

-\<a<b<\. 

For, a number k can be found such that 

Ul, 1A| < A < 1. 

In the interval 

-h ^ X m h 
the remainder of the series, 

/ V X* 

obviously satisfies the inequality: 

1 I < 

ll-a:i " 1-A 

Now, choose m so that 

Then 

I r„(x) 1 < €, m S 71, q.e.d. 

Observe, however, that the series 1) does not converge uniformly 
in the interval 

2) - 1 < X < 1. 

If it did; i.e. if 

1 Snf {x) - w 1 < €, mg 71, 
then it would follow, on setting ti' = ti + 1, that 
1 x" I < €, m ^ n. 
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But m cannot be so chosen that 

\x^\ < €. 

for all points of the interval 2), since 

lim = 1. 

The series 1) does, however, converge absolutely in the interval 
2). We see, then, that absolute convergence does not insure uniform 
convergence. 

Exfrcise 

Show that the series 

( 1 — x) 4- (x- — x^) 4- 4- * * * 

converges absolutely in the closed interval 

0 ^ :r g 1. 

Observe that the terms are all ^ 0. 

Prove that the series converges uniformly in an arbitrary interval 

Ogxg/i, 0<A<1; 

but that it does not converge uniformly in the interval 0 ^ r = 1. 

Plot accurately the first four approximation curves, using different 
colors — green, yellow, blue, red. Represent the limiting locus by a 
firm, black graph. 

§3. Weierstrass’s M-Test. A sufficient condition for the 
uniform convergence of a series is the follov^4ng. 

The A/-Tfst. The series 1) of §2: 

Ml (x) 4* Ii2 W 4- • • % 

converges uniformly in the point set A if a convergent series of 
positive {or zero) constants 

Ml 4- A /2 4- 0 g M„, 

can he found such that 

1 Urx (x) 1 ^ A/n, p* ^ n, 

where /t is a number independent of x. 

Proof, From the convergence of the M-series follows that to 
an arbitrary € > 0 corresponds an m ^ ft such that 

M„+i 4- • • • 4- M„/ < €, m ^ /I, /i'. 
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Since 

^n* M — S„ {x) = U„+i (x) + • • • + U„> (x), 

we see that 

1 Snf {x) — (j:) 1 ^ 1 Un+i W ] + ' * * + 1 Wn' (^) 1 

^ Mn+l 4 “ • * * + Mnt 

and hence 

1 Snf (x) — (j:) 1 < €, m ^ n, n'. 

This proves the theorem. 

Example, Consider the series 

sin X L sin 2 x ^ sin 5x 
12 22 3^'^’*’* 

The series 

J_ JL J_ 

T® 2^ 32 ' 

is known to converge. Set- 

Mn = \. 
nr 

Then the Af-Test shows that the series converges uniformly for all 
values of x. 

Exercises 

1. Show that the series 

1 + A:^ siv? ip + sin^ ^4 , 

where A is a positive constant <C 1, converges uniformly for all 
values of ip, 

2. Does the series 



converge uniformly in the interval — i? In the interval 
- 1 < a: < 1? Why? 

3. Prove that the series 

09 

^ {an cos nj: 4- ^ sin nx^ 

n=*l 

ocnverges uniformly for all values of a: if the series 
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both converge absolutely. 

4. Show that the series 

1 + X -h ~ -h - -f • • • 

converges uniformly in any bounded interval, but in no unbounded 
interval. 

§ 4 Continuity. TiiKORr.M, Let the terms of the series 
lil (^) + W2 (^) -b * ' • 
he continuous in the closed interval 

o. X ^ h, 

and let the series converge uniformly in this interval. Then the 
function f (x) defined by the series 

f{x) = Ml (x) + (x) -f • • • 

is continuous. 

Let Xq be an arbitrary point of the interval. We wish to prove 
that to an € > 0 chosen at pleasure corresponds a (T > 0 such that 

1) l/W-/(^o)l < «. Ix-Xol < (J. 

By hypothesis, to an arbitrary e' > 0 corresponds an m indep- 
endent of X such that 

2) I r„ (x) I < €, m ^ n, 

for all points x of the interval. In particular, then, since 
/(x) = Sn{x) + r„(x), 

we see from 2), on setting n = m and writing the resulting inequal- 
ity first for Xq, then for x, that 

3) 1/(j:^o) - t < «'• 

4) yf{x) — s„{x) 1 < c' 

On the other hand, m being now a constant, we infer from the 
continuity of the Un (^) the continuity of the sura, Sm (^), of a fixed 
number of them. Hence 

5) 1 Jm (a?) “ 5m (x5) 1 < C', jx-Xol < ^. 
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Combining the inequalities 3), 4), 5) according to Chap. II, § 10 
we obtain the relation: 

6) l/W— /(xo)| < Se', lx — xol < <y. 

If, then, we choose which is at our disposal, equal to J €, the 
relation 6) becomes the relation 1) which we wished to establish*. 

EVKRCtSKS 

1. Let 

Ml (x) + + ••• 

be a series whose terms are defined in the points of an arbitrary 
infinite point set Af, and let the series converge uniformly in M. Let 
X = c be a cluster point of Af, — regardless of whether c is a point 
of M or not. (In particular, c may be the point co.) Let each 
term approach a limit as x approaches c: 

lim Un {x) = Un. 

Then 

i) The series of limits: 

/7i 4* f/2 + • • • 

converges. 

* It is well worth the student’s time to study this theorem and its proof 
geometrically, interpreting the condition of uniform convergence: 

5m (^) — € < S„ {x) < 5m + € 

as meaning that all the later approximation curves lie in the strip bounded 
by the curves 

:r = 5m (:r) — €, jy = 5m (^) 4 €, 

Then narrow the strip by choosing a new ^ e, 
and show eometrically what happens. 

From a geometric appreciation of what is 
going on analyticrally it is possible to see that 
the limiting locus must be a continuous curve, 
and then to establish this result rigorously by 
analysis; i.e. by means of the inequalities which 
define continuity and uniform convergence. 

The details are given in the author’s Funk- 
tionenthearie^ vol. I, Chap. Ill, § 5; and also in the BvlL Amer. Math, Soc, ser. 
2, vol. 3, Nov. 1896. 




140 


FUNCriONS OF REAI. VARIABLES 


converges 


ii) The function f (x) defined by the series, 
/(x) = Ui (x) + M 2 (x) + • • • 
litn/(x) = A. 


iii) The limit of the series, namely A\ and the series of the 
limits, namely 

are equal, or 

A = B. 

The result can be written compactly in the form: 

lim f (x) = lim (x) -f lim ii^ (j:^) + • • • . 

x=e je=c jr=c 

2. When rn is a natural number, 

m ' m ' m •' 


/ 1 x" 

(l +-) = 1 + 1 + — 

V m / 1 


2 1-2-3 

to m + 1 terms. 


Pmve that 


(i + -) 

V m / 


approaches a limit when m = oo, and that 

/ 1 11 

limfl-f— ) =1 + 1 + — + — + 

m ' fit * 


2! 3! 


3. Let the factors of the infinite product 


fj [ 1 + M„ (x) ] 

71 — 1 

be continuous in the closed interval a ^ x ^ b. Let the series 
Ml W + Mj (x) + • • • 

^tisfy an M-test; 

1 «„ (x) 1 S M„, m ^ n-, 

S Mm convergent. Show that the product represents a continuous 
function, f{x) ; and that 

/(^) = n f 1 + “n (^) ] f (^). 

7>=1 

where p is fixed, and fp{x) is continuous and does not vanish. 



UNIFORM CONVERGENCE 


141 


4. Prove that the infinite product 



represents a continuous function, for aH values of x. Show 

that f{x) has its roots in the points x = 0, ±1, ± 2, • • •, and that 

lim exists and ^ 0, 

x=n X — n 

n being any integer. 

§ 5. Power Series* Consider the power series 

1 ) ^0 + 4 - . . . 

For a particular value of x different from 0^ x' ^ 0, let its terms 
be bounded: 

g G. 

Set I x' 1 = X. Then 

i.z„| g GX-\ 

For an arbitrary x such that | x | < X the series 1) converges 
absolutely. For 

I a„ x" 1 = 1 I • I a: I” ^ G ( ) . 

The series whose general term is this last expression is a convergent 
geometric series, and the theorem is proved. Let the result be re- 
stated as 

Tueorrm 1. If the terms of the power series 
flo 4- flix + 4- • • • 

and hounded for a particular x' ^ 0, the series converges absolutely 
for all X in the interval 1 x ] < 1 r' ]. 

A power series may converge for all values of x, like 



or it may diverge for all x ^ 0, like 

x-|-21x^-h3!x® -b •••. 
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In all other cases the points for which the series converges constitute 
an interval: 

- R < X < R, 

together with one, both, or neither of the end points. 

For, let ^ be a positive number for which the series converges. 
The point set } $ | is bounded, since bv hypothesis the series diverges 
for some -r = x'\ It cannot, tlierefore, converge for a £ > i U 
because of Theorem 1. 

Let R be the upper li nit of the point set j £ j. Then this is 
the R of the theorem. We will foriiiulate the result as 

Tnf;()Rr.M 2. The domain of convergence of a pou er series 
iihich converges for some, but not all values of x ^ 0, is an 
interval 

- R < X < R, 

to which one or both of the end points may still have to be 
adjoined. 

For the interior points of the interval the series converges abso- 
lutely. For the end points all conceivable behaviors occur. 

The term “convergent power series” is used by some writers to 
describe a power series which converges for values of t ^ 0. 

The interval (— R,R) of 1 heorern 2; or in case the power 
series converges for all values of x, the point set — oo -< x < oo, 
is called the interval of convergence. 

So much for the plain convergence of a j)ower series. We turn 
now to the question of uniform convergence. 

Tiir.OKtM 3. A power series converges uniformly throughout 
any subinterval {a, b) which together with its end points lies within 
the interval of convergence : 

-R<a<b<R. 

For it is possible to choose a positive number h so that 
\al \ b\ < h < R. 

In the point x ^ h the power series will converge absolutely: 

I ^0 i + i I ^ -f I ^2 I "h ‘ » 

a convergent series. If, then, we set 
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I i 

ihe conditions of the M-test will be fulfilled in the interval 

-h ^ X ^ K 


and so the theorem is proved. 

It has already been pointed out in § 2 that a power series does 
not in general converge uniformly in its interval of convergence. In 
certain Ccises it may do so, els: 



— 1 ^ ^ 1 . 


The terms of a power series are continuous for all values of x. 
It follows, then, by the aid of § 1- and the theorem just proven that 
a power series represents a continuous function throughout any sub- 
interval (^r, h) of its interval of convergence. This is not the same 
thing as saying that it represents a continuous function throughout 
its whole domain of convergence; but it is true, nevertheless, that 
it does. 


Theorem 4. A power series represents a continuous function 
throughout its whole domain of convergence. 

Let x^ be any interior point of the interval of convergence, 
(— R, R). It is then possible to choose the interval {a,h) so as to 
include J in its interior. Hence the function defined or represented 
by the power series will be continuous in x\ But .r' was any 
interior point, and so the theorem is proved for all such points. 

But this is not the complete theorem. Consider, for example, 
the series 


X — 



- 1 < ^ ^ 1 . 


We have not shown that the function is continuous in the 
point = 1 of the domain of convergence, nor can we show it by 
the M-test, since the series 


1 



does not converge absolutely. 

In a remarkable paper, on the Binomial Series, Abel supplied 
precisely the proof that is needed here. It depends on a lemma 
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which he introduced and which is of importance in many branches 
of analysis ; cf. § 6. First, however, one last theorem on power 
series. 

The OR KM S. If a power series vanishes identically in the 
neighborhood of the origin^ each coefficient • is 0. 

Let 

+ ^2 + • • • 

be a power series which converges in a certain region, — R <, x <. R, 
and let it vanish for all values of x for which — h <. x <. h, 
where 0 <. h ^ R: 

0 = flo + 1 X + ^2 + * * * 

Set X = 0. Hence ’^ow 

0 = + ••• =: x{ai + ^ 2 -^ + **')» 

where this last power series converges, — R < x < il; Chap. VI^ 
§ 1. It follows, then, that 

0 = ai + fl2^+’**, 0< |xl < h. 

This series represents a continuous function, by Theorem 4. 

Let X approach 0 cis its limit. Then 

0 = aj. 

On repreating the reasoning it appears that am ^ 0, and this 
completes the proof. 

CoROLiARV. If two power series, 

^0 4- X -f ^2 4- • • * , 

X + ^2 "h * ’ ■ * 

have the same value at all points in the neighborhood of the 

origin, then corresponding coefficients are equal: 

an — bn-t n = 0, 1, 2, • • * . 

For, their difference can be represented as a power series, 

(Oo - *o) + (<*1 — ^i) X + (a2 - + • • •, 

which vanishes identically in the neighborhood of the origin. 
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ExERCtSFS 

1. If 

flo + ^ ^ + • • • 

converges in the interval (— R, il), show that 
ai + 2^2-^ + 3^3 • 

converges in the same interval. 

2. If a power series converges in a certain interval and vanishes 
at the origin, but does not vanish identically, show that it has no 
second root in the neigborhood of the origin. 

3. In the older books Theorem 5 was often proved as follows, 
and this proof was copied in the school algebras. Set a: = 0. Hence 
Oq = Oj and so 

0 = ai a: -h * * • . 

Divide through by x, thus getting : 

0 = -f ^2 + • • * . 

Now set a: = 0 again; thus ai = 0. And so on. What is wrong 
in this proof? 

4. After the error mentioned in Question 3 was pointed out, 
the writer of the school algebra modified his proof by saying: “In 
the equation 

0 = rti 4- ^2 ^ + ’ • • , 

let T approach 0 as its limit. Then 0 = What assumption was 

he making here? 

5. Given a power series: 

flo + ^1 + ^2 H • 

If 

< 4- . 0 < A, m g n, 

ti 

show that the series converges when — ^ < x < A. 

6. Show that the power series of Question 5 will converge for 
all values of x if arid only if 

litn ^ I On I = 0. 

n=oo 
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§6. Abel’s Lemma.* Let 

1) 4- Wo -f • • • + 


and 

let 


2) 

VII 

VII 

« 

A* = 1,2, • • • , w. 

Let 


' 

3) 

€1 ^ €2 ^ • • • 

^ ^ 0. 

Then 


4) 

^ 4 - CoWo + 

• • • 4* W 72 ^ €1 y/. 


Proof. Since 



Wi = 5i, Wo = ^2 

T 

4= 

1 

1 ! 

we 

can write: 



€1 wi 4- €2 Wo "b * 

* * 4" Un — 


€j 5^ 4" €2 (^2 -^l) "b * * 

• + €/j {Sn — ^j.-]) = 


(ci — € 0 ) -^1 *b (^2 ^ 3 ) -^2 "b * * 

• + (Sn— 1 fn) -^/J— I + in ■'>n 


Multiply the A: th relation 2) through by €;t "" — L 2, • * • , 

71 — 1 ; the 7i-th by €n, and add. The rei>ult is the relation 4) 
which the Lemma calls for. 

Application. Let the ]X)\ver series 1), § 5 converge for j: = r ^ 0. 
Then it converges uniformly in the closed internal from x = 0 to 
X ~ r. 

We wish to prove that, to an arbitrary € >• 0, corresponds an 
771 , independent of x, such that 

5) 1 + • * • + am-\-p I < €, /? — 1 , 2, • • • , 

where 0 ^ ^ r or else r ^ or ^ 0. 

From the hypothesis of convergence for x = r follows that 
— c' < am^x ' -r am^-pX^^P < €', /? =: 1, 2,- • 

Now choose ~ ^ — J ’ Then 

r X \ ^+1 i X \ 

-(f) *'*(7) 

+ a (i) 

• Journal fur Maihematik, vol 1 (1826) p. 511. 
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r X \ '"+1 

or, since 0 ^ ^ — j ^ 1, 

6) — ^ am-i-i 4- • • * + am+p 

If, then, we take 0 <C c' < €, 5) will follow from 6). 
Thus the proof of Theorem 4, § 5 is now complete. 


Exerctsfs 

1. It can be shown by mathematical induction that 

cos jx — cos (^2 -h ^)x 


sin jc 4- sin 2a: + • • • 4- sin nx - 


2 sin i a: 


X ^ 2k T. 


Prove that the series 


sin X , sin 2a: , 

_r + ^_ + ... 

converges uniformly in any interval (a, b) which together with its 
end points lies within the interval 0 <1 a: *< 2 t*. 

2. The same for the series 


where 


Cl sin a: 4- C 2 sin 2a: 4- 


q ^ C2 ^ 


lim Cn = 0. 

n~x 


3. Show that 


^ . , rk I I cosnx — cos(«4-l)a: 

1- cos X 4” cos 2x4“ * * * 4- cos nx '=■ — t : — — 

2 2 (1 — cosx) 


4. What can you say about the uniform convergence of the 


senes 


N cos X , cos 2x , ^ 

b) Cl cos X 4- C 2 cos 2x4* * • * ? 


§7. The Binomial Series. In the noted paper cited in § 6 
Abel discussed the series 

1) l4-mx4- — — ^x^d----, 

L * 

making no assumptions about the function it may represent. 
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If m is a natural nu iiber^ the series breaks off with a finite 
number of terms and so converges for all values of x. Its value is, 
by the bin(nnial theorem, 

2) (1+x)'". 

For any other value of rn the series converges in the interval 
- 1 < :r < 1 

and diverges when \x\ > 1. Denote its value byy^(m, :r): 

3) / (m, x) = 1 4* m X -h ^ ^7.2 -^“ + * * * » -- 1 < x < 1 . 

Give X such a value and hold it fast. Then 

4) fim + n,x)=f (m, x)f [n. x), 
as we will now show. 

Denote the binomial coelficient by mj^: 

-X m (m — 1) • • * (m — A: -h 1) 

ur^k 

Then the series that define the factors on the right of 4) can be 
written: 

f (m, a:) = 1 mi x m 2 x^ • • • ; 

f {fly x) = \ 4* + ^2 + ’ ’ * • 

These series can be multiplied together by the theorem of Chap. 

VU, § 5: 

6) f {m, x) f{n,x) = \ 4- (mj 4- ^i) :r 4- (mo + m^ rii 4 no) a:- H 

We wish to identify this latter series with the one for y^(m 4* n, x): 

7) / (m 4- n, x) = 1 4- (m 4- n)i X 4- (m 4* n )2 H . 

This can done expeditiously as follows. Observe that the coef- 
ficient of X* in 6) is a polyno nial (m, n) of degree not higher 
than k in each argument. The same is true of the series 7). Now, 
when m and n are natural numbers. Equation 4) is true, because 
of 2): 

8) Gk (m, n) = (m 4- n)^ . 

Hence 8) is true for all values of m and n by the following theorem. 
An Algebraic Theorem, Let 

aox” + ai x^~^ + • • • + am 
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be a poIvnoMiial wliicli v<inishes tor tn -f 1 distinct values of the ar- 
gument: X = • • •, 'I’tien each roelTicient = 0. 

Suppose the theorem t.dse. i.et <7ji he the lir^t coetti'ient that 
^ 0. It surelv will not he Novv 

a-j .1'""'“'^ -h fly.+i -H • • • 4- r/m - (-r — • • • [r — 

Set T — and this last expression must vanish. I>iit no factor 
vanishes, and liere is a contradiction. 

Secondly, let 

G {.r, y) ~ Ai, if) jr"" + Ai (_>') A ••■+ Am (y), 

where 

(.>") — ^ + * * • 4 - , 

he a polyno nial w4iich vanishes in each point (.r, jr) = 
w^here are m 1 distinct numbers, and likewise 

* 10 ^ * * *•> *]/! ‘'^re n -f 1 distinct 

numbers. Then each eoefficient 

= 0 . 

For, Q^ve to r an arbitrary 
value »)y, and hold it last. 'I'hen 
G(.r,.ij;) vanishes for •••, 

im- Henc« each vanishes; 

(’?;) A' — 0, 1, • • • , m. 

Hold k fast and let rjj run through 
the n 4- 1 values l]^), rji, ij,,. Thus we see that each = 0. 

The proof of the relation 4) is now complete. 

The lunction, r) can be evaluated on the b^.sis of the 

functional equation 41 an 1 the continuity of the funcrloii uilierent in 
its expression hv means of the series. First, a digress'.rci 

On the Fiuictional Fquafiifti 

9) F iv 4- j) = iT (x) F (F) . 

Let 

F hr) , — CO < X -< CO , 

be a solution. 

* Cauchy treated this and allied functional ecjuitions in the Conrs d'cnalyu 
al^fbriqiie of 1821 ; Chap. 5. 
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i) If F{x) vanishes for a single value of j::. 

F (xq) = 0 , 

then 

F(x) = 0. 

For, set y = xq. Then 

F{x + ^o) = PM = ^ 

for all values of x. 

ii) Excluding the case just considered, we see that 

0 < F (:r), — oo < or < oo . 

For 

iii) Again, excluding Case i), let x — y = 0. Then 

^(0) = F(0)2. 

Since F (0) ^ 0, it follows that 

10) F(0) = 1. 

Let 

11) F(l) = a. 

Then 

Fi2) = F(^)F(i) = a^ 

F(3) = F(2)jF’(l) = a», 

and, generally, 

F (m) = a”, m = 0, 1, 2. • • • . 

Next, let X = = .i Then 

F{l) = F(.i)Fii), 

Fm = ai. 

Since obviously 

F{xi + X 2 -” +Xn) = F{xi)Fix 2 ) • • • F{x„), 
it follows that 

12 ) 

That a positive n-th root of any positive number exists — and only 
one such root — was shown in Chap. II, § 10. 
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We now infer that 


^ frn \ HL 


where m and n are any two natural numbers. 
Let y ~ — X. Then 

F(0) = F(x)F(-x), 


F{-x) = 


Fix)' 


Thus we arrive at the result that 

15) Fii) = a\ 

where f is any commensurable number. 

Continuity. Concerning the continuity of F (x) we know 
nothing. We readily see, however, that if F [x) is continuous for 
a single value, x = Xq, then F {x) is continuous for all values of 
X. For, 

Fixo + h)- Fixo) = Fix,) [Fih)-l]. 

If the left hand side approaches 0 with h for a single Xq, it follows 
that 

lim F{h) = 1. 

Hence the left hand side approaches 0 for an arbitrary Xq. 

The Function f (m, x). Identifying the function f {rUy x) with 
F{m) we see that 

fim,x) = (1 + x)". 
or 

16) (1 + x)'” =1 4- m X -h - x^ + • • • 

for all rational values of m. 

On the other hand the series 16) represents a continuous func- 
tion of m for all values of m. For, it converges uniformly in any 
bounded interval, and its terms are continuous. Let M be any posi- 
tive constant. Then 

I m(m — 1) • » • (m — t + 1) 1 1 < 


M (M + 1) • • • (M + ^ — 1) I ^ li _ ^ 
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and the series 

Ml -+■ A/o “K ‘ ‘ * 

is shown at once to converge. Hence^ j:) is continuous in the 
interval (— M, M). 

Let m = m' be any value of rn. Then M can be so chosen 
that m' will lie within the interval (— /Vf, M). Hence f{m^x) is 
continuous in the point Tn\ and the theorem is proved. 

The Function a^. Let a be any positive constant less than 2. Set 
= X = a — \. 

Then 

- 1 < a: < L 

and this is a value of x such as we have been considering. 

If follows, then, that for such a value of a there is a function 
of 772, continuous for all values of m and coinciding with 

for all commensurable values of m. We define for irrational values 
of m as equal to this function. Thus the function or a*, is 
single-valued and continuous for all values of the exponent, m or 
if 0 < a < 2. 

If ^2 ^ 2, let 

a 

Since 


when m is rational, and since is continuous and positive for all 
values of m, it follows that there exists a function continuous and 
positive for all values of tti, Euid coinciding with a!^ when m is 
rational. We define aP^ as equal to this function when m is irra- 
tional. 

Thus the function is defined and continuous for each positive 
value of a. Moreover, 

On the other hand we have found the most general continuous 
solution of the functional equation 9): 

F{x)^aP, = F(l); or F(a:)^0. 



UMFORM CONVERGENCE 


155 


The Functions log x^. With the aid ot the results just 
obtained, together with the Exercises that follow, it is possible to 
develop systematically the theory of the functions 

log x^ x^. 

The reader will find in profitable to make this study later. A better 
first approach to these functions, however, is through the integral; 
Chap. VI. 


Exercises 

1. If j: is a constant numerically less than unity, show that 

(1 + x'r - 1 _ X- 

m=0 m 2 3 

2. If F (x) is a continuous solution of the functional equation 
9), show that 

;i=o n 

exists. 

3. Show that a continuous solution of the functional equation 
9) hfis a derivative: 

d Fix) ipf \ 


h 0 h 


4. Prove that 


Ii.n (l+-) =l + l+ ^ + ^+ -- - 
u V p. / 21 31 

when fL becomes infinite, passing through all real values numerically 
greater th;m 1. 

5. Assuming the properties of the functions log x, developed 
in Chap. VI, discuss the functional equation: 

F(x + j) = F{x) + F{jr). 

Show that its most general continuous solution is: 

F{x) = cx, — oo <1 X <C OO, 


where c is a constant. 
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§8. Integration of Series. Let a convergent series of con- 
tinuous functions be given: 

1) /W = Wi (:r) + (a:) 4- • • a x ^ h. 

Can it be integrated term-by-term? i.e. will 
h h h 

2) //( x) dx = ^ Ui {x) dx -f ^ U 2 {x) dx • • • 

a a a 

be a true equation? 

Let us analyse this question in detail. There are really three 
questions here rolled into one: — 

a) Will the series 

h h 

3) ^ Ui (x) dx -f ^ (:r) 4* • • • 


converge ? 


b) Can the fimction f{x) be integrated? i.e. does 


4) 


J/M 


dx 


have a meaning? 

c) If the answers to Questions a) and b) are both affirmative, 
will Equation 2) be true? 

Consider the approximation curves, 

5) y = s„ {x), 
where 

^/i (^) = (x) 4- • • • + Un {x). 

They ai*e all continuous, and so 

h 

5n{x)dx 

a 

means the area under the zi-th curve. 

Consider the series 3). Let 

6 ) S„ = J {x) dx -{ ^ J* ^ 


dx. 
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The series 3) converges if Sn approaches a limit; and conversely. 
Now, 



a 


Hence Question a) is the question of whether the area under the 
curve 5) approaches a limit. 



fix) =0, 0 g T g 1. 


The value of Sn is the area of the isosceles triangle, or 



We have not yet said how hn shall vary with n. Suppose, for ex- 
ample, that 


i) hn = Then 




n 

2 


and the series 3) diverges. So, naturally, there cannot be any (Ques- 
tion of integrating it term-by-term. — Suppose, however, that 


ii) hn n , Now, 




1 

2i/ n 


The series 3) converges, and its value is 0. On the other hand the 
integral 4) converges, and its value is 0, too. So here the series 1) 
can be integrated term-by-term. — Lastly, let 
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iii) hn = n. Consequently 

Sn=h 

The series 2) converges; but its value, is not equad to the integral 
4), or 0. 

We see, then, that even though each side of equation 2) may 
have a meaning, it does not follow that the equation is true. 

A sufficient condition for integrating a series term-by-term is 
the following. 

Theorem. Let the terms of the series 
ui [x) + 1/2 (j:) + • • • 
be continuous in the closed interval 

a ^ X b, 

and let the series converge uniformly in this interval. Then the 
series can be integrated term-by-term: 

fix) = ix) -h W 2 (•^) + • • • ; 

k 5 

(x) dx — ^ Uiix)dx ^ U 2 ix)dx + • • * 

a a a 

Proof. The function fix) is continuous; Theorem, §4. So the 
integral ^ 

8 ) J f{x)dx 

a 

has a meaning. Next, let 

fix) = Snix) + rnix). 



Then, the functions 5/i(x), rnix) being continuous, we have: 
h b b 

f{x)dx — J* Sn ix) dx= J rnix) dx, 

a a a 

Since the series converges uniformly, 

I Tb W 1 < € , m ^ n. 


Hence 


b b 

f rn{.x)dx ^ f { r„(x)ldx 


< — fl) € , m ^ n. 
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It follows, then, that 



< {b — a) €, 


m ^ n, 


\ a a I 

and so i) the series of integrals converges; and ii) its value is the 
integral of the series, or 8). 


Exercises 


1, Show that a powder series can be integrated term-by-term. 
State this theorem precisely. 

2. Prove : 


r. 





3. Prove: 


2 

/ 


/ 1 


e- sin- <p 




\2-4-6y 5 J 


0 ^ c < 1. 


4. Give a new example of a series of continuous functions which 
does not converge uniformly, and still can be integrated term-by- 
term. 

5. In €-proofs like the above we have hitherto used two c’s — 
the € of our adversary, and the of our own. Throw the proof 
of the Theorem of the text into that form. 

6. I^t 

ao Oi X + 02 • • • 

be a power series which converges when 0 ^ x <. h, but diverges 
for X — h. Suppose, however, that the series 

+ + ••• 

converges. Show that the former series can be integrated term-by- 
terin in the interval 0 = x = /r. 
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Formulate precisely each item, or detail, in the theorem you are 
asked to prove. 

Example : ^ ^ 

log2 = l-- + --.... 

7. Consider the series of the I’heorem proved in the text. Show 
that the series 


X X 



U 2 (^) dx 


+ ••• 


converges uniformly in the interval (fl, b). 


8. Does the series for which 




1 


0 ^ :r ^ 1, 


1 + n ’ 

converge uniformly? Can it be integrated term-by-term? 
Plot the first few approximation curves. 

9. The same for 

2n^x A ^ < 


XT 

10. Show that the series 

1 . 1 


0 ^ X ^ 1. 




4- 2^ 4” ^ + x^ 


converges unifonnly in the interval 0 ^ x < oo . Can it be in- 
tegrated from 0 to oo ? 

11. It can be shown (cf. Chap. VIII) that the function 

/ sin X , sin 2 X , , sin n x 

Sn z 1 h • • • 4 - — 

12 n 

is bounded for all values of n and x. Show that the series 
sin X , sin 2 X , 


can be integrated term-by-term throughout any interval. 
12. Prove that the series 

V 2x 

can be integrated tenn-by-term. 
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§ 9. Differentiation of Series. Let a convergent series of 
differentiable functions be given: 

1) f {x) ~ (:c) 4- Wo (:r) -I- • * • , a ^ x. ^ h. 

Can it be differentiated term-by-term? i. e. will 

2) /' (x) = u[ (x) 4- Wo (x) 4- * * ' 
be a true eq;uation? 

This question, like the corresponding one for integration term- 
by-term, consists of three parts: — 

a) Will the series 

3) u[ (x) 4- 1^2 W + * “ 

converge? 

b) Can the function y^(x) be differentiated? i. e. does 

4) /(jtq + Ax) —fixp) 

Ax 

approach a limit when Ax approaches 0 ? 

c) In case the answers to Questions a) and b) are both affirma- 
tive, will 2) be a true eqution? 

Consider the approximation curves 

5) y = s„ {x), 
where 

Sn M = Wi (x) 4- * • • 4* W„ (x). 

Each one has a tangent at every point, and so 

means the slope of the w-th approximation curve at the point x = Xq. 
Consider the series 3). Let 

6) Sn W = ui' (x) 4- ' • • 4- w' (x). 

The series 3) converges at a point x = Xq if Sn (xq) approaches a 
limit; and conversely. Now 

7) S„ (jt) = (ar). 

Hence Question a) is the question of whether tiie slope of the curve 
5) at a point x = Xq approaches a limit. 
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Example. Let* 

1 +n2'^’ 


— oo < j: < (X). 


The series 1) converges and 

/W = o. 

The function {x) is here: 


At the origin, 


1 - 

(1 +/l*x*)* 



lim Sn (0) = 1 . 


I’hus the series of the derivatives, 3), converges. The function 
f{x) has a derivative at the point x — 0: 

f{0) = 0. 

But the derivative of the series, namely, (0) = 0 ; and the series 
of the derivatives, namely, 

1 = ( 0 ) U2 ( 0 ) + • • • , 

are not equal. 

A sufficient condition for differentiating a series term-by-term 
is the following. 

Tkkorem. Let the terms of the series 

8) Ml (x) + Mg (x) -h • • • 

have continuous** derivatives in the closed interval 

a ^ X ^ by 


• To plot the curve 


begin with the curve: 


r » 


X 


T 


1 


Then make the transformation of similitude. 


SM 


X 

» 

n 




y_ 

n 


•• The restriction of contiQuity can be removed by means of a different 
proof, cf. { 10. 
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and let the series converge. Let the series of the derivatives, 

9) (x) + t4ix) + • • • , 


converge uniformly in the interval. Then the series can be dijfer- 
entiated term-by-term : 

10) f{x) = «i (x) + Uj (x) + • • • 

11) f{x) — u[ (x) 4- M 2 (^) + • • • 

Observe all that the theorem contains. It is first and foremost 
an existence theorem respecting the derivative of f (x). It asserts 
that, at an arbitrary point x = x' o£ the interval, the variable 

12 ) /(x^ + Ax) -fix') 

Aj: 


approaches a limit as Ajc approaches 0. Finally, it identifies the 
derivative f' (x) with the value of the term-by-term derivative series. 
Proof. Let 

15) f (x) = u[ (x) + (x) + • • • . 

The function ^ (x) is seen to be continuous by § 4. And by § 8 the 
series 15) can be integrated term-by-term: 


14) 



X X 



dx -p • • • 


= [ Ui (x) — Ui (xo) ] + [ «2 (^) — “2 (•^o) ] + • • • 


By hypothesis, the series 8) converges for x ^ Xqi 
15) /{xq) = Ml {xq) + M2 (xo) -4- * * • . 


On adding 14) auad 15) we find: 

X 

f ip (x) dx + /(xo) = Ml (x) + (•*) + • * 


X 

fix) = J fix) dx f (xo). 

*0 


Hence 
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The function on the right of this equation has a derivative, since 

d ^ 

dxS ^ dx = <p (x). 

Therefore f{x) has a derivative, and 

f{x)^ip{x). 

This completes the proof. 

We could have stated and proved a more generaJ theorem, since 
we have used the hypothesis of the convergence of 8) only for a 
single point. If, then, we had demanded that 8)- converge in one 
point, X = Xq, of the interval, our proof would have shown that 8) 
necessairily converges in the whole intervaL 

But this formulation of the theorem would be unfortunate for 
the needs of practice, since in the applications of the theorem one 
always knows in advance that the series 8) converges, and so this 
other formulation, by stating and proving what is known before 
hand, would have distracted attention from the mEun hypothesis, 
which one must show is fulfilled, namely, the uniform convergence 
of 9). 

It has turned out that the series 8) converges uniformly. But 
this property would not help in the formulation of a sufficient con- 
dition. The series of the above Example converges uniformly, but 
it cannot be differentiated term-by-term. 

Example, A power series can be differentiated term-by-term. Let 

16) flo + ^ ^ • 

converge in the interval 

- R < X < R, 

Consider the term-by-term derivative series: 

17) ai 2 a2X + 5 as x^ ~h • 

Its terms are continuous and it converges in the above interval; §5, 
Eixercise 1. 

Let x' be any point of t)ie interval. It is possible to find a posi- 
tive number h such that \ x^ \ h R, In the interval (— A, A) 

the series 17) converges uniformly. Hence 16) can be differentiated 
term-by-term in the point x'. But x' is any point of the interval. 
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Observe the order of choice: — first, J \ then the interval 
{—h,h). It would not be possible to prove the theorem by applying 
the test to the interval {— R, R)j since a power series does not in 
general converge uniformly in its interval of convergence. 

Remark. The corresponding theorem in the complex domain 
is simpler. If Un {z) is analytic in a two-dimentional region S of the 
complex :z-plane, and if the series 

Ui (z) + Wo (^) 4- * * * 

converges uniformly in *S. then it defines or represents a function 
f{z), analytic in *S, and the series can be differentiated term-by-term 
in S. 


Exercjsfs 

Show that the following series can be differentiated term-by- 


term. 


1 . 


^ 2x 

2^ _ 2 • 

n=rl 


2 . 




n=3l 


3. 


X[ — --]• 


4. s riog(i +— ) -xiog(i + — )]. 

n=i *■ n n J 

5. Show that the series 

1 1 1 

zn . -f* . — . . . 

V a y a T y a -f 2 t 

converges uniformly in the interval 0 ■< a < 4-00 

6 . Show that the series of Question 5 can be differentiated 
term by term. 

7. If, in Ex. 3, § 4, Un (x) has a continuous derivative and the 
series 

u[ (a:) + (x) + • • • 
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sadBes an M-test, the function will have a derivative given by 

the series 

f{x) 1 + «„ (ar) 

provided no fax:tor vanishes. 

Complete the theorem for the case that a factor vanishes. 

§ 10. Double Limits and the s (n, m) - Theorem. The 

foregoing cases of the continuity of a series, its integration term-by- 
term, and its differentiation term-by-term, are examples of double 
limits. Thus, for continuity, we start with a convergent series of 
continuous functions: 


/ W = Ml (t) + M2 (x) + • • • 

and inquire when fix) wiU approach a limit as x approaches Xf,, 
that limit to be (xo) : 


1) Iim/(x) =/(xo). 

Now 

fix) = lim s„ (x), 

n=oo 


and so the left hand side of 1) can be written: 


2) lim r lim (^) 1 • 

XbbXq L TVesoo J 

On the other hand, the right hand side of 1) can be written as 

3) lim r lim s„ (x) 1 

t x=Xq -* 

For, Sn (x) is continuous at x == Xq and so 


(^o) = Sn (x) ; 


and 

fM = Hmsnixo), 

7T=5oo 

The question of continuity reduces, then, to the question of 
when the double limits 2) and 5) will be equal, or 
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Again, in integration term-by-term, the question is: When will 
h h 

5) if lim Sn (-c) \ dx — lim I Sn (x) dx ? 

^ '«c=ioo ^ n=eo^ 


Since the definite integral is itself by definition a limit, we have 
here, too, the formulation of the problem in terms of the equality of 
two double limits. 

And, thirdly, in difterentiating a series term-by-term. Here, 


6a) 

whereas 

6b) 


f ix) = lim r lim 1 

^ 71=00 £^X J 


u[ {x) + «2 (x) + • • • 


= lim r lim 

72c=aoe L A-»v — ^X J 

That two double limits are not in general equal, even when 
both exist, has appeared time and again in the foregoing pctragraphs. 
But if this is the point to be illustrated, a far simpler example can 
be given. Consider the function 


Here, 
and so 

But 


9 y) = — * 0 < X, 0 < y. 

^ X -\-y 


lim <p (x, y) = 5, 

x-O 


lim ^ lim ip (x, y)J^ = 5, 


lim ip (x, y) = 2, 
:r=o 


lim [linuf^Cx, j) =2. 

Thus each of the double limits converges, but their values are 
not the same. 

The short proof given in the older books on the Calculus for 
the theorem : 
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dx By dy dx 

WcLs based on the assumption that, when each of two double limits 
exists, their values are equal. And the same criticism holds for 
applying the rule for determining the limit 


lira 

j?=sa 


fix) 

Fix) 


= lim 
x—a 


/M. 

F'ix) ’ 


a second time, when (a) == 0 F' (a) = 0, thus arriving at the 
result : 


lim 


IM. 

Fix) 


— lira 
x=a 


JIM 

F'ix) ’ 


etc. 


It was not until the middle of the last century that this procedure 
was justified by sound proofs. 

The following theorem has a wide range of applications in ques- 
tions relating to double limits. It is an outgrowth of the theorem of 
§ 4, Exercise, and it will be convenient to state it first in that 
restricted form. The notation, s(m, n), is so chosen as to suggest the 
sum of the first n terms of a series. 


«i (m) + «2 (m) + • • • , 
whose terms depend on a parameter, m\ 

sn (m) = Ml (m) -h • • • + (m), 

s (m, n) = Sn {m), 

Tiikokem. Let s{m,7i) be a function of the two natural 
numbers, m and n, which satisfies the following conditions: 

a) s (m, n) approaches a limit when n becomes infinite : 

lim5(m, n) =y’(m). 

TtsssX 

b) s (m, n) approaches a limit when m becomes infinite : 

lim s (m, n) = Sn- 

mmax 

c) s (m, n) converges uniformly, when n = oo : 

I s (m, 7i') — s (m, m) I < €, v ^ M, n', 

* 

where v does not depend on m. 
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Then: 

i) f {m) approaches a limit, when m = oo; 

lim f{m) = A. 

mc=s* 

ii) Sfi approaches a limit, when n = oo ; 

lim S„ = B. 

n=oo 


iii) 

Or: 

7) 


A==B. 


lim lim s (m, n) = lim \ lim 5 (m, n) . 

m=oo ^ -* w=oo L Tn=^oo J 


Proof. In Condition c) let m = oo: 

8) 1 — 5„ 1 S €, I' ^ n, n'. 

Hence Sn approaches a limit; denote it by B: 

lim Sn = B. 

nsszoo 

In 8) let n' = oo : 

a) I B 1 g €, y ^ n. 

In Condition c) let n' = oo: 

(5) |/(m) - n) I Sc, v S n. 

Finally, let /t be so determined that 

y) I — s (m, v) I < €, ft S m. 

On writing a) and fi) for 71 = 1 ^ and combining with y) we 
have: 

|5— /(m)| < 3c, ft S nz. 

Hence f(m) approaches a limit. A; and A = B. 

Both theorem and proof admit an immediate generalization as 
follows. Let { x 1 be an arbitrary point set having a cluster point 
X =^ a , or extending to + 00 (^z = + 00) or to — 00 (a = — 00). 
Similarly, let [y] be a point set with y = 3 as cluster point (in 
particular: i = -f 00, — 00). Let s (x, y) be a function defined for 
each point x of [ a; } and for each jy of \y\^ where a?, ^ are chos^ 
arbitrarily and independently. And now the hypothesis is: 
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a) lim j (x, y) shall exist ; denote it by f (x). 

jrtsslf 

b) lim 5 {x, y) shall exist ; denote it by ^ {y), 

X=ra 

c) I s(x,y) - s(x,y I < €. {J < Yy,Zl I < h 

where S is independent of :r. 

The conclusion is : 

i) f(^) approaches a limit: 

limy(x) = y4. 

Xksrra 

ii) yiy) epproaches a limit: 


lim ^ (y) — B. 


iii) 


Or: 

9 ) 


A = B. 

lim I lim s (x, r) 1 = lim lim s (x, y) | . 
x=a L j Y=^b L x=a J 


g ^ n,n, 


g ^ n. 


Remark, From the hypotheses of the theorem it does not follo\^ 
that in Gindition c) the r 6 les of m and n can be reversed. It can, 
indeed, be inferred that, to an arbitrary positive €, correspond two 
numbers, p and g, such that 

1 s {m\ n') — 5 (m, n) I < • €, p m, m'; 

If we set 7 i' = 71 , we get : 

\s{m[n) — s (m, n) i < €, p ^ m, m'; 

But g depends in general on €. As an example let 
, . sin (n/ m) 

10 ) 5(771,71) = 

Of course, there is nothing paradoxical in this situation. The 
existence of a two-dimensional limit, as 

11 ) lim 5(771, 7 i), 

(mj /i.*=s(oc, 00 ) 

does not in general carry with it the existence of either of the one- 
dimensional limits: 

12 ) lim 5 (771, 77), lim 5 (tti, n). 


Example : 


15 ) 


, V sin 771 . sm 71 

5 (771, 7l) = h 

71 771 
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And conversely, the existence of both these one-dimensional limits 
is not enough for the existence of the two-dimensional limit 11): — 


Example: 

14 ) 


5 (m, n) 


n m 

-f- 77Z^ 


The uniform condition c), combined with the one-dimensional limit 
120), does insure the existence of the two-dimensional limit 11). 


A Further Extension, Let j x j denote a point set in space of 
n dimensions, and let (fl, • • • , Or^ be a cluster point of the points 
(j;i, •••, jr„) of the set. Let \y\ be a point set in space of m 
dimensions, and let be a cluster point of the points 

* * *» ym) of this set. In particular, one or more of the a’s may 
be infinite, 00, — 00, or 00 ; and similarly for the b's. 

Let s {x, y) — s {xi, • • • , :r„ ; • * * , yn) be defined for each 

point (x) of {:rj and for each (y) of \y\, where {x) and (y) are 
chosen arbitrarily and independently. 

The last form of statement of the theorem can be interpreted as 
it stands for the present case. But to avoid so much abbreviation we 
will say — 

Hypothesis : 

a) liin s {xi, • • • , :rn ; j'l, * • • , ym) 

shall exist. Denote it by 

f{xi, •••, Xn)- 


b) 

shall exist. 


lim s{xi,---,x„\yi,---,ym) 
W={«) 

Denote it by 


c) I S (xi, • • ,x„-, y[, • • •, ym)—sixi, • • •, • • •, Jm) I < €. 


0< < <y. k = u---,m, 

where S is independent of (xi, • • •, ar»). 

Conclusion : 

i) /(^i, * • X/,) approaches a limit t 


Ihn f{xi, 

(x)mm a) 



170 


FUNCTIONS OF RFJVL VAHIAULES 


ii) y » * * * » Jm) approaches a limit : 

lim (p{yu * • '^ym) = B. 

ir)={b) 

iii) A B. 


10) lim I lim 5 Ui, * • • , Ji, • • jm) 1 = 

lim I lim s {xj,, • • % Xn; yu * • • , Jm) 1 • 

irj=(b)^ (x)==(a) J 

Ekfrcisk 


Show that, in the s (m, n) - Theorem, Condition c) can be re- 
placed by the following: — 

c) s (m, n) satisfies the relation : 

1 s (m, 7i') — 5 (m, n) I < €, ^ < m, v ^ n, 

where ^ and v both depend on €. 

The conclusion will be the same as before. 

§11. Application: Differentiation of Series. The theorem 
of § 9 is adequate for the needs of practice. If is of interest, however, 
to note the following 

Theorem. Let the series 

1 ) Wi W -f- ^2(0:) -b ' • • 
converge in the interval 

a <, X < h. 

Let Un {x) have a derivative and let the series 

2 ) u[ {x) + 1/2 (x) + • • • 

converge uniformly in an arbitrary svbinterval whose end points 
lie in the interval. Then the function 

3) f {x) = Ml (x) -b Wo (^) + * • * 
has a derivative and 

4) /(x) = uy (x) + (x) + • • • . 

Proof. Jjet 

5) s„{x) = Ml (x) + • • • + «^(x). 
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I«t Xq and jTo + Ax be two points of the interval. Let 
S (Ax, n) = y 

Ax 

Then i) lim s (Ax, n) = s^ (xq); 

ii) lim s (Ax. n) = fir±±A^) " /(^o) , 

n==‘x /ikX 

and we wish to show that 

6) lim j lim s {Ax,.n) j = lim f lim s {Ax, n) 1 . 

This cx)nclusion will be justified if 

iii) 1 s (Ax, n') — s (Ax, n) j < €, v ^ n, n', 

where € > 0 is arbitrary and v is independent of Ax, Now : 

7) s (Ax, n') - s (Ax, n) = T »,(xo + Ax) - u,(x^ 

Let f (x) = s„» (x) — Sn (x). 

Then the right hand side of 7) has the value 

= 

Uo + 9 Ax) — (xo + 0 Ax). 

Because of the uniform convergence of the series 2) w'e have : 

I (^) — •*» (^) I < €. V ^ n, n', 

where v is independent of x, no matter where x lies, and hence 
when, in particular, x ^ x^ 6 Ax, This completes the proof. 

The theorem is more general than the test of §9 in that it 
does not presuppose the continuity of the derivatives (x). It is less 
general in that it demands the convergence of the series 1) for every 
.r instead of for a single x. The theorem is found in Harnack’s 
Differential- and Integralrechnung, § 129. 
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§12. Condensation of Sinsfularities. In the examples of 
non- uniformly convergent series hitherto considered, the removal of 
the neighborhood of a single point of the intervcj of definition of the 
terms yields a new interval, in which the series converges uniformly. 
This situation is not characteristic for the general case. A series of 
continuous functions may converge toward a continuous function: 

f{x) — iZi (x) + + * * •, a ^ ^ b, 

and yet the convergence may be non-uniform in every subinterval: 
a ^ X ^ ^ b. 

If is easy to construct such examples by a Method of Condensa- 
tion of Singularities, due to Hankel. Such an example is studied 
in the Author’s Funktionentheorie, vol. I, 1928, p. 92, and illus- 
strated by graphs. Starting with the function 

1) y = = j/2e X 

the graph of which is readily plotted, form the function 

2 ) <P/i{^) = sin^ Tx), 

It is now easy to plot the graphs of the functions: 

X = f„{x\ j = ^f„(2!x), 7 = ^V’„(3 !x), •••. 

Form the series, the sum of whose first n terms is: 

3) (x) = fn (^) + (2!x) + • • • ■¥ — >pn («!a;). 

Z I 72 I 

This series converges to the value 0 for every x, hut it 
converges non- uniformly in every interval. 


A further important application of this Principle is to the forma- 
tion of non-analytic functions of real variables. A function of the 
real variable, x, is said to be analytic at a point, x = Xq, if it can 
be developed into a power series in the neighborhood of the point, 
i. e. developed by Taylor’s Theorem. The classical example, due to 
Cauchy, of a function which is continuous, together with its deriva- 
tives of all orders, and yet cannot be developed by Taylor’s Theorem, 
is the following: 


/ (x) = e ^ Q. 

/(O) = 0. 
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I'br the point aro = 0 all the derivatives vanish, The Taylor’s ex- 
pansion : 

f{xo) + xf’ (xo) + ^f'(xo) + 

converges, but it represents, not the above function, f {x), but the 
function 0. 

Cauchy’s example has this pecularity in only one point. It is 
easy, by Hankel’s Principle, to construct examples of functions which 
have derivatives of all orders in every point, but which cannot be 
developed by Taylor’s Theorem in any interval. Such an example is 
the following. Let 

5) ip (x) =y (sin rx), 

where y* (x) is the function 4). Then 


5) 


* (^) = 2, („!)» 


..=1 

is the desired function ; 1. c. p. 126. 


Exercises on Chapter V. 

1. Show that the series: 

oo 

2 ) ^ “ 1 * 

whose coefficients a„, hn are bounded, represents a function which is 
continuous, together with all its derivatives, within the circle r <C 1, 
and statisfies Laplace’s Equation: 

2 d^u , du , d^u _ 

2. Let 

Cl -p ^2 + • * • 

be a convergent series. Show that the series: 

sh ^ , sh 2t , 

shfl sh2fl 

converges uniformly in the interval 0 ^ ^ 

5. Does the series 

^ 2x 

A 

nsssl 


converge uniformly: 
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i) in the interval — J ^ ^ J ? 

ii) in the interval — 1 < x <, I ? 

iii) in the whole interval — oo < x < oo^ the points = 0, 
it 1, it 2, * • • having been removed? 

4. Let the series 

Uiix) + U2{x) 

converge unifonnly in the interval 

a ^ X < b 

and let it converge in the point x = h. Show tliat it converges 
uniformly in the closed interval 

a ^ X ^ b, 

5. l^t 

fix) = Uiix) Uoix) • • • 
be a series which converges uniformly in the interval 

a ^ X <. b, 

the terms being continuous in the closed interval a ^ x ^ b. 
Show that fix) approaches a limit when x approaches b. 

6. Ijet i^) be defined in the interval a <C x <. b^ and let 
the sum 

*Pl (•®) + (^) + * • ‘ + fn (^). 

regarded as a function of x and n, be bounded. Let 
0^1 ^ 0^2 ^ , lim cHji = 0, 

nt=s 

be a set of constants. Show that the series 

«■! (^) + a2 f 2 (^) + • ‘ • 

converges uniformly. 

7. Let (x), ip 2 (x), • • • be defined in the interval a <, x <, h 
and let 

^ <Pn{x), n < n' ■, 
lira (pn {x) — 0. 

mssx) 

Let Cl, C 2 , • • * be a set of constants such that 
Cl + C2 + • • * + c^ 

is bounded, n = 1, 2, • • Show that the series 

Cl fx U) + Co 9>2 U) + • • ' 


converges. 
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Give an example of such a series which does not converge 
uniformly. 

State a sufficient condition, that the series converge uniformly. 

8. Lety(j:, a) be a function which, for each a of an infinite 
point set is defined for every value of a: in the interval 

a ^ X ^ h. 

Let ao be a cluster point of A, not belonging to A, Let f {x, a) 
approach a limit when (x^ a) approaches (xq, ao), where Xq is an 
arbitrary point of the interval (a, and a is restricted to the point 
set A. Denote the limit by ^{xq): 

if (xo) = liTTi /(x, a). 

(x, Oo) 

Show that ip (x) is continuous in the interval (a, b). 

9. Prove, furthermore, that the function f{x,(t) of the pre- 
ceding question converges uniformly as a approaches olq. 

Is the converse proposition true? — namely: If /(x, a) is defined 
in the points ^ x = Z?, a in and if /(x, a) converges uniformly 
as a approaches ao, then f{x, a) approaches a limit when (x, a) 
approaches (xo, ao), where Xo is an arbitrary point of the interval 
(a, b) and a is restricted to the points of A, 

10. Can a function which is everywhere discontinuous approach 
a limit i) non-uniformly; ii) uniformly? 



Chapter VI 


The Elementary Functions 


§1. The Trigonometric Functions. The noblest branch of 
Physics is Geometr}", or tlie physical science of space. Next in im- 
portance, in the physical sciences, is Kinematics, or the science of 
motion. The most important class of motions is that of oscillations — 
the oscillation of a point, the vibration of a membrane, a wave in a 
three-dimensional region of space. The simplest case is that of Simple 
Harmonic Motion, dominated by the differential equation: 


dP‘x 

IF 


-h r^x = 0. 


If we change the variable from t to r, where 


r ^ nt, 

the new equation becomes : 


Sx 

dr^ 




0 . 


It is tl)is differential equation which dominates the whole class 
of phenomena known as waves, and so it is natural to enquire what 
tlie fimctions are which constitute its solution. We will change the 
notation and write the differential equation in the form : 

fA) ^+^ = 0. 


By a solution of this equation in a given interval is' meant a 
function, 

y =/U). 

which has a second derivative at each point of the interval and satisfies 
the differential equation; i.e. causes the left-hand member to vanish 
identically: 

11 is clear that such a function admits continuous derivatives of 
dll orders. For, {x) exists by hypothesis, and is continuous, since 
y" {x) exists. Moreover, y" {x) is continuous, since 


fHx) = -/(*). 
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Next, exists and is continuous, since this last equation has 

on the right-hand side a function with a continuous derivative. And 
so on. 

Solution by a Power Series. As the interval oF definition we 
will begin with one including the point x = 0, and enquire whether 
there be a solution given by a power series, 

y -{■ ai X (h • • • . 

Suppose this is the case. Then 

= 2a2 + 5- 2«3X-f ••• \)an -h • * • . 

A necessary condition is obtained by adding these two series. The 
result is a power series that vanishes identically. Consequently each 
coefficient must vanish. 

clq “ 1 - 2*1 cUi = 0 , ct^ -|- 3 * 2 ^3 = 0 , 

^Z2 + 4*3^Z4=0, ^3-1- 5 *4^25 = 0, 


The coefficients and ai can be chosen arbitrarily. The re- 
maining coefficients are then determined uniquely. Thus, if = 0, 
= 1, we find the series 


X 


x^ x^ 

sT ^ 


and if ^0 ~ L = 0, the series 

X- X* 

1 ^ + 47 ~ 

Both of there series converge for all values of x and so define 
two functions : 


1) 


.W = X-- + -- 


. X- X^ 


Conversely, these functions are solutions. For each of them, 
when substituted in the differential equation (A), is seen to satisfy 
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it. Or it would be possible to start with the equations for the 
coefficients and show that each step can be retraced. 

I’he function 5 (x) is odd, and c (x) is even : 

2 ) s{—x)=—s{x), c(—x)=c(x). 

Moreover, 

5(0) = 0 , c( 0 )=l. 


I'he Derivatives of s(x), c{x\ Observe that 

5) W = c(ar), c^(x) = — 5 ( 0 :). 

( s'(x)=- c{x). 


Hence 


4) 


s"{x) = - s (x), 
s"'(x) = — c (a:), 

1 ^ {x) = s {x\ 

and now the further derivatives repeat themselves periodically in 
blocks of four. 


The Addition Theorem. From this property and from the 
continuity of the functions s (x), c (a:) we now infer by the aid of 
Taylor’s Theorem with the Remainder that can be developed 
about an arbitrary point, x = x^i 

^2 ^3 

5) s {xq ^ k) = s (uto) + C (to) h — s (xo) r: — c (oto) ~ + • * * 

Z\ 01 


The right-hand side can be written in the form: 


“ I + 4! 
+ ^(^ 0 ) [h - -- + -- 



Hence we see that 

6 ) s{xq h) = s (j:,)) c (A) -f c {tq) 5 {h). 


A similar relation holds for c(xq 4 - h). Since Xq and h are both 
arbitrary, we may write more symmetrically : 

( s(m + V) = 5(u)c(v) 4 - c(7/)s(v). 

7) ^ 

( c{u v) = c (w) c (v) — s(u)s (v). 


Thus we have obtain^ the Addition Theorem for these two 
functions. 
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The Pythagorean Identity. Differentiate the function: 
s (x)® + c {xf : 

A [,(^)2 + ,(^)2] =2[.(x)c(x)-c(x).(x)]^0. 

Hence 

+ c{x)^ = A*. 

Setting X = 0, we find: A = L Hence 

8) 5(:r)2 4- c{xY = 1- 

We shall see a little later that it is reasonable to describe this 
relation as the Pythagorean Identity. 

Roots of s (x), c {x). .The function c (x) has a positive root. 
For, suppose this were not so. Turn to the function s (x). Since 
s (0) = 0, and, by hypothesis, 

s' (x) = c (x) > 0, 

it follows that s(x) is positive and increasing for all positive values 
of X, By the Law of the Mean 

c(x) = c (a) — (x — a) s (X^), a < X < x. 

If a > 0, 

0 < s{a) < s(X), 

hence 

c{x) < c (a) — {x — a) s (a). 

But the right-hand member is negative for large values of x, since 
s{a) '> 0. From this contradiction follows that c(x) has a positive 
root. Let p/2 he the smallest positive root of c(x). 

Further Identities, Periodicity, From the Addition Theorem 
it follows that 

9) S{x+^)=C{X), C(x+|)=-5(X). 

Furthermore, 

10) s{x + p) = — s (x), c{x + p) = — c (x). 
and finally : 

11) 5 (x + 2;>) = j (x). 


c (x + 2p) = c (x). 
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This last identity shows that the functions s(x), c(x) admit the 
period 2p. It remains to show that this is a primitive period. 

The function c{x) is even, and hence ~-;7/2 is the first negative 
root. The graph of the function 

r = 

in the intei*val — p/2 ^ x ^ p/2 
is, then, as shown. From this 
graph w’e obtain the graph of 
y = s {x\ ^ ^ X p, 

by the transformation 

a/ = x + |- 
and the relations 

Since s {x) is an odd function, the graph in the interval : 

^ p/2 ^ a: ^ 0 

is found by rotating this arch about the origin through 180*. 
Finally, the periodicity gives the complete graph. 

That 2p is a primitive period is now easily shown. For, let o) 
be any positive period. Then 

s (x 4- cd) = s (x). 

Hence, in particular, 

5 (to) = s(0) = 0. 

Thus to must be a multiple of p. But the odd multiples are not 
periods. The figures for s(a:) and c{x) are found on p. 196. 

The Simultaneous Equations: 5 ( 0 :) = a, c(x) = p. Let h have 
any value between — 1 and 1, inclusive; 

- 1 ^ A ^ 1. 

The equation 

12 ) c(x) = h 

has two distinct roots in the interval — g a: g if — 1 < /^ < 
and these are equal and opposite, Xi and . If A = 1, there 
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is a single root, x = 0 and if h — ~ the roots are x — p and 
— p. Only one of these latter, however, should be cx)unted, because 
of the periodicity. — Similarly for si^x). 

If a, 3 are any two numbers such tlKxt 

13) a- + 3" = L 
the equations 

14) s{x) — CL, c{x) = P 
admit one and only one solution in the interval 

0 ^ X < 2p 

or, generally, 

n X <. a + 2p, 

wh^re a has any value whatever. For, consider the second equation 
in the interval 

p < X ^ p. 

It admits twp distinct roots, Xi and xo, where 


x.2= — Xi, 

if — 1 < P < 1. But ^Cr^) = — s{xi) ^ 0, and so only one 
of these satisfies the first equation. 

— The cases p = 1, — 1 are dealt 
with directly. They do not form 
an exception. 

Definition of Angle, Con- 
sider two directed line segments 
in the plane, Pi Po and P[ P.L 
By the angle, 9, from Pi Po to 
P{ P 2 shall be meant any solu- 
tion of the simultaneous equations: 



15 ) 


r2 - y'l - 

^2 - 72- 7i 


72 - 7 i ^2 - ^ [ 

s(&) = K 1 

72 —71 ^2 - 
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ic = -j/ — x'J- + — y[f •/ (-ro - jti)- + (jo — jif. 

The definition is ^invariant of the transformations of the principal 
group (Hauptgruppe) i.e. translations, rotations, and stretcliings ; but 
a reflection carries B over into — 0, Moreover, 0 is invariant of the 
choice of 'Pj, on a given line, provided merely that the sense of 
the vector Pi Po is preserved; and similarly for Pj, P^. Finally, 
the vectors Pi Po and P[ P^ can be replaced by any equal vectors. 
— I'he proofs of all these statements are simple, and are* left to the 
reader. 

In particular, then, the lines Pi P 2 
and P[ P 2 can always be replaced by 
two radii of the unit circle ; the first, 
drawn to the point (1, 0), the second, 
to the point (j*, y). The definition then 
gives : 

16 ) c{e)^x, s(B)=x. 

Thus a unique value of 0 ^ 0 < 2^ 
is obtained. 

Equality of Angle and Arc, The number B thus defined is 
equal to the length o' of the arc of the unit circle, measured from 
(1,0) in the sense corresponding to the increasing ordinate near this 
point. For, 

r/<r2 dx- + dy^ ^ [P{Bf + s\Bf]dB^- = dB\ 

17) dtr^dB, 

Angles in Geometry. In Elementary Geometry an angle is 
defined as the figure made by two lines which have an extremity in 
common. Each “line” may be a line segment or a ray. 

To such an angle is assigned a number — its 
measure — by choosing an arbitrary angle as the unit 
and applying it to the given angle in the usual way. 

It is this number which we have defined above as 
the angle B, with the usual extension of the definition to positive and 
negative angles. 

The functions s(e) and dO) are now seen to be identical with 
the sine and cosine as ordinarily defined in Trigonometrj' : 

18 ) s{0) = sm9, c {9) — cos 9. 
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The General Solution of Equation {A). I^t 

y=f(x) 

be any solution of Equation {A) in the neighborhood of the point 
X ^ a. Then two constants, and can be so determined that 
the solution 

<p {x) — Cl sin j: -h Co cos or, 

together with- its first derivative, will tally with f(x) at x = a: 
f{a) = Cl sin + Co cos a 
f* [a) = Cl cos a — Co sin a 

since the value of the determinant is — 1. Thus the solution 


\ir(x) — fix) — ifix) 


is such that 


Hence xj/- {a) — 0 for all values of n. 

Now, any solution of {A): 

y = F{x\ 

can be developed by Taylor’s Theorem about an arbitrary point 
a: =c. For, 

F^^^{x) = ±F{x) or ±r{x\ 

according as n is even or odd, and so Taylor’s Theorem with the 
Remainder applies. Hence vj/- (x) s= 0, and the theorem is proved. 

§2. The Logarithmic Function. The definition of the log- 
arithm which leads most easily to the properties of this function, is 
by means of the integral. I^et 




0 < X < CO. 


This function will, or course, turn out to be the natural logarithm 
of X. But we are not assuming any knowledge of special functions, 
except what has already been shown regarding the rational functions 
— in particular, their continuity — and so it is better to use a nota- 
tion that suggests logT without the danger of taking for granted 
properties not yet established. 
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From the definition follows at once that 
21 L(1) = 0; LM<0, 0<a<l; L(a) > 0, a > 1. 



Theorem 1. The function L{x) is continuous for all positive 
values of x. It has a derivative^ given hy the equation: 

3) L' (j:) = — . 

X 

Thec^ri.m 2. The function is monotonk increasing: 

4) L{x) < L{y\ X < y. 

For, by the I^w of the Mean, 

L{y) - L{x) + {y - x) V[x ^e{y-x)l 
and IJ ix) is positive for all values of the argument. 

Corollary. From 

L(x) = L{y) 

follows that 

x^y. 

Theorem 3. The Functional Relation. The function L{x) 
satisfies the functional equation : 

U) L{x)^ L{y) = L{xy) 

for all possible values of the arguments. 

Let the left-hand side of Equation {A) he written in the form: 
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In the se<x)nd integral, change the variable of integration: 


Thus 


Hence we sec that 



X y X xY 

S ~ s ^ s 


1 1 I 

This last integral has the value: 


X 

J 


y = Lixy) 



and the theorem is proved. 

By setting y ■= \/x in (J) vve find: 

L{x) + L (y) =L(1)=0. 
or 

5) L(y)=-£(x). 


By setting y = x in {A) we find: 

L{y^)^2L{x\ 

Similarly, 

6) L (x") = n L (or), 

where n is any natural number. 

Thf.oiu.m 4. The function 7^{x) becomes positively infinite 
for X = -f oo, and negatively infinite for :r = O'*’; 

L(+ oo) = + OO; LiO'^) = — oo. 


Set :r = 2 in 6). Then 

L(2”) = nL(2). 

Now, 2" be:ones infinite with n, since 2” > n. The right-hand 
side becomes infinite with n, since L{2) > 0. The function L{x) 
is monotonic increasing. l‘his proves the theorem for or = + 
The proof of the second part follows from 5). 
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§3. The Exponential Function. The function L{x) admits 
an inverse, defined and continuous for all values of the argument. 
Denote it by E {x) : 

1) y = E{x) if X = L{y). 

It is clear that 

2) E{x) > 0 , — oo < X < CO, 

Moreover, 

3) E(-oo) = 0, J5;(0) = l, ^(4-co)=+oo. 

TiiEOREM 1. Addition Theorem. The function E{x) admits 
the Addition Theorem: 


(B) E(x A r) = Eix)E(y). 

T his relation is the precise counterpart of {A)y §2. 
and y be any two real numbers. Then the equations : 

U - E (x), v = E (7), 

admit unique solutions, for u and v are both positive : 

x — L(u)y y — L{v), 

Now, by § 2, Theorem 3 : 

L{u) d- L{v) = L{uv). 

Hence 


X ^ y = L (iw\ 

and so, by definition : 

E {x A y) = uVy 


For, let X 


or 

E{x + y) = E (x) E {y)y q, e. d. 

Theorem 2. The function E(x) admits a derwativCy 

4) E^ (x) = E (x). 

For, if 

y = E (x)y then x = L(y ) ; 

and if 

y -1- Ay ^ E(x A Ax), then 
Thus 


:r + = L(y + Ay). 
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Ax = Z/(y H- Ay) — L{y) = Ay V {y + 0 y). 

Ay 1 

Ax L' {y + OAy) * 

Now, E (x) is continuous, (Chap. HI, § 9, Ex. 8) and so Ay 
approaches 0 as Ax approaches 0. Hence the right-hand side of this 
last equation approaches a limit as Ax appiuaches 0 : ^ 

r 1 ^ 1 

L'{y) ■ 

But 

.-w=±. 

Hence 

or 

E'{x) = E{x\ q.e.d. 

Theorem 5. The fimction E (x) can he expanded by Taylor's 
Theorem for all values of the argument: 

5) EUo + A) = E{x,) + A£'Uo) + ^ E"{x,) + • • • 

The proof is given in the Calculus, and need not be repeated 

here. 

In particular, let Xq = 0, h = x. Because of 3) and 4), 

6) A:(x) = 1 + a; + ^ + ^ + ••• 

Thus 5) turns out to be nothing more less than the Addition 
Theorem ; 

E{xq h)^ E (xo) E \h). 

Observe that we have here an independent proof of the Addition 
Theorem. 

The Function (F, We have, incidentally, a new proof for the 
existence of roots^ \/ a^ where a > 0 is any number. By definition, 

h = f/T if hft = a. 

In Equation 6) of § 2 sex n = x ^ h. Then 

L{b^) = qL{b), 
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L{b)^-L{a), 

1 I* 1 n 

av = EY — L{a)Y 

Equation 6) of § 2 is now seen to hold for all rational values 


8 ) 

Hence 


L (a?) = 0 < a. 
^ = E[^Lia)]. 


Now, the function 

E[xL{a)] 

is continuous for all values of x, and so we can define the function 
by the equation: 

10) ^ E[x L(a)^^, 

From this equation follows that 

11) L{a^) = xL{a\ 

or Equation 6) of §2 holds for 0 < x < co, — co < < oo. 

The Natural Base^ e. The functional equation {B) is precisely 
the one studied in Chap. V, § 7. Hence it appears that, if we 
define the number e as E{\): 

12) e==E{\\ 
the function 

13) E {x) = 

The number e can be computed from the series 6): 

14 ) .= , + , + ± + 1 +... 

" <f = 2. 71828 18284 59045 • ■ ■ 

The function E{x) having thus been identified with its 
inverse, L [x), is seen to be log x by the usual definition of the latter 
function: 

12) HU) = logx. 
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§4 A Simpler Analytic Treatment, The foregoing treat- 
ment of the Elementary Functions has the advantage that it links the 
trigonometric functions with the simplest of oscillatory motions, thus 
emphasizing their periodicity at the outset ; and it yields the proper- 
ties of the logarithm with a minimum amount of computation. 

From the standpoint of pure analysis, however, one must admit 
that there is no simpler limiting process than that of power series. 
It is possible to make the differential equation 


1 ) 



the point of depaurture and to seek a solution in the form of a power 
series. VVe arrive immediately at a particular solution: 

2) E{x)= 1 + ^ + § + ^+ ••• 


The derivative of this function has the value, from Equation 1): 


3) 


E>{x) = E{x). 


Now follows the developability of this function by Taylor’s 
Theorem : 

A" 

4) E{xo + h) = E (xo) + kE' (xo) + — E" (xq) + • • • 

Hence 

E(xo + h) = E(xo) E{h), 
and herewith the Addition Theorem : 


5) E{x + y) = E (x) E (y). 

The theory of this functional equation leads at once to the 
identification of E {x) with e‘\ 

6) E {x) = e*. 

In particular, then; 

7) E{x) > — OO < X < CO; 

8) £(-oo) = 0+ JE(0) = 1 , £(+oo)= + io. 
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I’he existence and the properties of the function and the 
treatment of the logarithm as the inverse function, follow without 
artificialities of any sort. 


The Trigonometric Functions. The use of imaginaries is so 
familiar to the electrical engineer of the present day, that the 
■j/ — 1 can no longer be regarded as a mathematical fiction, even by 
the practical man. If, then, starting with the traditional equation 

9) = cos ^ 4- i sin f = l/ — 

we define two new functions by the equations: 


S{x) = 


^ - e~^ 
2i 


cix) = 


- we prove immediately by elementary algebra that these functions have 
the properties: 


5(.r +7)=S(x) C(7) + C(x)S(7); 
C{x + y) = C{x) Ciy)- S{x)S{y). 


12 ) 

13) 

14) 


S'ix)=C{x), C'(x)=-S(x). 


S(x)^ + C(xf= 1. 


S(x)=x — 
C(x) = 1 - 


— 4 

3! 51 

— 4 " 

21 4! 


Finally, the periodicity is established as in § 1, and by means 
of the angle these functions become identified with sinx, cos a:: 

15) S(x) = smxj C{x) = cosx. 

§ 5. Partial Fractions. Development of cot x. The 

functions tmx, cotx, secx, cscx can be represented by infinite 
series which are analogous to the representation of a fraction by par- 
tial fractions. The fundamental equation is the following: 
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This equation can be obtained immediately from the develop- 
ment of a function into a Fourier’s series; cf. Chap. VIII, §1. An 
elementary deduction can be given by means of de Moivre’s Theo- 
rem : 

^ m (m — 1) . o 

cos m ^ = cos'” (p ~r~o — ^ V ^ 

m (m — 1 ) (m — 2) (m — 3) . 4 

— i LI Li i cos'” * <p sm^ ^ . 

4! 


sin m<p — m cos'”"'^ ip sin ip — ^ 


(m — 1) (m — 2) . o 

L^ ^ cos'” ip sm® ip 


31 


-f ••• 


We see that cot m ^ is a rational function of tan ip : 

cotmy= ■ 

G (tan ip) 


Let m be odd : m = 2 / 1 . -f 1. The fraction on the right is a proper 
fraction, as is seen by allowing ^ to approach the limit t /2 ; for 
then the left hand side approaches 0 as tan ip becomes infinite. 

We proceed to represent this fraction by means of partial frac- 
tions. The degree of the denominator is obviously not greater than 
m. On the other hand we can write down m distinct values of 
— ‘r/2 < ^ < V /2, for which cot m ip becomes infinite, namely: 


= ±~, 

m 

Consequently, 



± tIL. 

m 


6r (tan ^) = tan ^ ftan^ — tan^) Ttany-f tan — ) 
' \ m ' ' m * 


We thus find : 

^ Ak 

cot my = 2) ■ 

*=-(» tan y — tan — 

Tfl 

To determine the coefficients multiply through by sin m y 
and then let ip approach the limit kT/m, All the terms on the 
right approach 0 except the term in Ak, which takes on the indeter- 
minate form 0/0. The limiting value is found by the usual method 
of the calculus. Thus 
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7 Aj, m cos k V 
cos kT — — ^ 


) k TT 


Ak = — seG“ - 

m m 


On setting m<p = x vve obtain the final formula : 

c ~-2 


1 ) 


or: 


2 ) 


cot X 


fj- 


m 


l— 'a ^ kTT " 

^ m tan m tan 

m rii 


cot X 


1 


+ 2 


2 sec** — m tan 

rn m 


4. ^ c, cX O O 

m tan — *=i rnr tan“ m' tan 

m rn 


Allow m to become infinite. The terms on the right of 2) 
approach limits, and it would not have occurred to the mathema- 
ticians of even a hundred years ago to question the inference that 


3 ) 


ot 




2x 




This result is correct, but it requires proof. 

The right hand side of 2) can be regarded as an infinite series 
whose terms depend on m (a; is a constant, ^ ± k tt) and which 
converges for* m = 1, 3, 5, • • • : 

/(m) = Wo {rn) -f Wi (m) -f- • • • 


The terms of this series approach limits as m oo; namely, the 
corresponding terms of 3). And now the series of the limits, i. e. 
the right-hand side of 3). and the li'nit of the series, i.e. the left- 
hand side of 3), will be equal if the series converges uniformly; cf. 
Chap. V, §4, Ex. 1. or § 10. That this is the case can be shown 
by an Mutest, We have already chosen x. Let A > ! t i. Then 


X 

m lan — 
m 


< A, 


mo ^ 771 . 


* It may happen that for small values of m the function tan is not 

defined. In that case, begin with a larger m; i. e. let v ^ m. 
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On the other hand, the function fix ) : 


( 

1 


/U) = 


sinx 

X 


fiO) = 1 


0 < X g 


T 

^2 


is continuous and positive in the closed interval (0, r/2), and hence 
its minimum value, h, is positive. Hence 


0 < h < 


sin X 

X 


If, then, we set 




2A 


0 < g 


V 




we have here an M-test. This completes the pr(X)f. — On replacing 
X by TTX, the development 3) goes over into i^A). 

Corresponding developments for the tangent can be obtained, 
either by the same method or by a change of variable, x — \ — x^ \ 
or still again by means of the identity: 


Thus : 
4) 


V vx 

-2 


tan X = cot X — 2 cot 2x. 
^ 2x 


{2n + If - ’ 


5) tan X ~ 


2x 


2x 


2x 


m--'- 


2 / V 2 

The identity : 

Sin X 

leads to the development : 


1 ^ 

— = cot cot X 

2 


6 ) 


1 


2x 


2x 


2x 


• y o I 9 ^ O O 

sin Tx X 1 — ar*' 2“ — ar 3^ — 
And now a change of variable gives : 

T . r 1 3.5 


7 ) 


TX 

COS -2 - 
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Linear Denominators. In one respect these formulas are lacking 
in simplicity : the denominators are factorable. I f we had tried to 
use E.quation 1) instead of Equation 2), we should have arrived at a 
series whose terms are 

1 

X — kir 

But the series 

y \ 

^ X + kT 


y L_ , 


do not converge. 

It is possible to obviate the difficulty by writing : 


2x f 

1 + M 

+ r ^ - M 

~ 1 

Thus ^ 

8 ) cot a: h T 

. X — A:r kr J 

r 1 + 1 • 

L X 4- A*t J 

1 +y r ^ ^ 

L :r — nir nv . 

i ^t^x + n'T n'T 


The introduction of the additive term l/^ir or — X/kv seems 
artificial. How did we come to think of it? A satisfactory answer 
can be given if we start, not with the cotangent, but with the square 
of the cosecant. Proceeding as before we find that 


1 I 1 

^ 2 ) (x-nrf 




(x- UTf + ^2 Vi- 


and this equation can be written in the simpler form: 


9 ) 


csc^ 




(x — n IT )- 


Consider any interv'al. 


The series; 


— = X = d. 


S - ^ 

{x — n vY ' 


1 


A <. mT^ 


V -t- n'rf ’ 

converge uniformly in this interval, and their terms aire continuous 
Hence 

oo 

^ riT »irJ 
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with a similar expression for the other integral. Now transpose the 
omitted terms in 9), so that the left hand side becomes: 


m— 1 




-m+l 




That indefinite integral of this function^ which approaches 0 as t 
approches 0, must be equal to the sum of the two integrals we have 
just considered. Thus we arrive in a perfectly natural manner at the 
development 8). It is customary to write it in the form: 


101 


cot 


. = 1 + X' [-_L_ + _L], 

X ^ X — 71 V TIT J 


the prime denoting that the value n = 0 is to be omitted.- 
The second form of the cotangent development is; 


11 ) 


1 

IT cot TX — 


X 



These developments have the advantage that each term of the 
series has a pole at just one point. 


Exercises 

1. Obtain the development 6) by means of partial fractions. 

2. Deduce Taylor’s expansion for sine and cosine from 
de Moivre’s Theorem : 




sin X = X 

+ — 

31 

5! 

9 

4 ^ 


COS o: = 1 

d — r~ 

2! 

4! 


3. Develop the definition and theory of the exponential func- 
tion on the basis of the limit : 

E{x) = \\xn (l r. 

ms=oo N 771 / 

Obtain the functional equation ; 

E{x+y) = E{x) E{y) 

directly from the definition. 

4. Replace each of the other developments by one in which 
the terms have a pole at only one point. 
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§2. The Commutative Law. If a series 

III + 1 / 2 + * * ■ 

converges absolutely, its terms may be rearranged at pleasure and the 
new series will converge to the same value as the old. 

For, let 

= wi + • * • + 


and suppose first that 0 ^ Un- Let the rearranged series be 

' I ' I 

izi + t/o + ' * ‘ 


v/ith 


f f • 
= 2^1 + 


If the value of the first series be denoted by Z7, then 

^ U. 


Hence the second series converges, and its value 


< U, 


Now interchange the series, regarding the first as a rearrange- 
ment of the second. Then 

U < O', 

and so O' = U. 

In the general case, let 

Sn (T p r (f f 

as in Chap, 1, §9. Let 

f t f 

Sn — (T pf T (jf . 

Then, by the result just established, 

lim (Tp = lim , lim = lim rj, , 

and the proof is complete. 

If, on the other hand, the given series converges conditionally, 
its terms can be rearranged so that the new series will converge to 
an arbitrarily preassigned value. A, For, take positive terms till the 
sum exceeds A ; then negative terms till the sum falls below A ; 
then positive terms again ; and so on. The process can be continued 
indefinitely, since the variables (Tp^ vq diverge monotonically toward 
-f-cxD. Moreover, since lim = 0, the new series will converge 
toward A. 
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The terms can evidently also be so rearranged that the new 
series will diverge toward + oo or — oo, or oscillate at pleasure. We 
can state the result as follows. 

TrtKOREM. Let 

+ “2 d 

be an absolutely convergent series^ and let 

ft ft 

+ ^2 H 

he a series made up of the UnS rearranged in any manner. Then 
the latter series converges absolutely to the same value. 

Exercises 

1. Show that, if every series formed out of the terms of a 
given series converges, the given series converges absolutely. 

2. Show that the terms of a conditionally convergent series can 
be rearranged without altering the value of the series, provided no 
terra is moved more than k places, where A: is a constant. 

§3. The Associative Law. Let 

Ml + % H 

be a convergent series. Then it is possible to insert parentheses at 
pleasure : 

(mi + • ' • + Mot|) + (Mm^+i + • • • + Umfj + * ' * 
and the new series will converge to the same value as the old. For, if 

= Ml + • • • + M„ 

and if sjf is the sum of the first k terms of the second series, then 
the are merely an infinite subset of the s„’s. Hence : 

1’hkorem 1. In a convergent infinite series^ the terms may 
be grouped in parentheses in any manner and the new series will 
converge to the same value as the old. 

The converse is not true. Consider the series of parentheses 
+ + ••• 

1‘his »ries converges; but if the parentheses are removed, the general 
term of the new series does not even approach 0, and so the series 
diverges. We can, liowever, state the following theorem. 
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Theorem 2. Let 

^ + * * * + 
k 

he a series of parentheses. If on removing the parentheses, the 
new series converges, then the old one does, also, and the values 
are the same. 

The proof follows at once from Theorem 1. 

TiiKORF.M 3. Consider a convergent series of parentheses. If 
the number of terms in a parenthesis remains less than a fixed 
number and if the general term in the parenthesis approaches 0» 
the parentheses may be removed; i,e, the new series will converge 
to the value of the old one. 


Exercises 

1 . If + <*2 "h * * * 

and 

4 - ^2 + * * * 

are convergent series, show that the series 

4 + ^2 4 ^ 4 • * * 

converges, and that its value is equal to the sum of the two given 
series. 

2. Extend the result to the sum of p series. 

§4, Double Series. By a double series is meant the array 
4 Ui2 4 iii 8 4 • • • 

4 ^22 4 ^23 4 • • • 

4 M 32 4 U 33 q- • • • 


where Umn is any function of the two natural numbers, m and n. 
Another form of the double series is: 

V Umn- 
m^n 

The series is defined to be convergent if eveiy simple series formed 
out of its terms converges. Thus if a double series converges, it 
necessarily converges absolutely. 
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This is the definition which is useful in the theory of functions. 
In special branches of analysis, like the developments for which 
double Fourier’s series are charatceristic, other definitions are expedi- 
ent. 

It is obvious that the series 1) converges if there is a convergent 
double series 

n 

such that 

I ^mn I = 

It is sufficient that these inequalities hold for 

M ^ m -f* n, 

where M is some fixed number. 

The terms of a convergent double series can be rearranged at 
pleasure. In particular, the rows and columns may be interchanged. 

Of the many ways in which a convergent double series may be 
evaluated, two are especially important: 

i) Summation by Rectangles : 


where the sides increase together in any manner — for example, al- 
Wfiys equal : 

Mil "h ^12 "h ^22 "h ^21 "h ^^13 "h *^23 •+•**' 
ii) Summation by Diagonals : 


-h ... 
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Example, 0)nsider the double series : 

1 ^ X + + • • • 

X 4- + * • * 

or + • 

If we sum by diagonals, we are led to the series : 

1 4* 2j: + 3:r- 4- • • • 

This series converges absolutely for all values of — 1 < :r < 1, and 
diverges for all other values of x. Hence the double series converges 
for — 1 < X < 1. 

The following criterion for convergence is useful in practice. 
Tkst for Convergencf. Let 

4 - vjo 4 - t'la 4 - • • * 
t’21 "{" t’22 4 " t’23 4 " * ' ’ 

^31 + ^^32 + " * 

be a double series whose terms are all positive or zero: 0 ^ Vnp> 

V 

i) the rows converge: 

Vn — Vni Vni • • • 

ii) the series of the values of the rows converges: 

Vi + 1^2 + 

then the double series converges. 

Proof, Denote by the sum of the terjrns occupying any area 
A in the scheme of the double series. Then 

For, choose n large enough so that A will be contained in the first 
n rows. Let 

5/1 — 4 “ ^2 + * * * + 

Then 

and 

^ r. 

Hence 

and the theorem is proved. 



ALGEBRAIC TRANSFORMATIONS OF INFINITE SERIES 205 


Tiir.OREM, Let 

+ Wjo + -f ■ • • 

Moi "f" ^2 ^^28 "f* * * ’ 

^31 + ^32 + * * • 

• ♦ 

he a convergent double series. Then 

i) the rows converge absolutely: 

4- w„2 + • • • ; 

ii) the series of values of the rows converges absolutely : 

LT = 4- ZZ2 + ‘ • 

iii) U is equal to the value of the double series. 

Proof. The truth of i) is obvious. Next, denote the value of 
the double series by t/'. Then, in particular, 

\ U' — s„p \ < V S n, p ^ p, 

where s„p is the sum of the first p terms from the first n rows. 
Allow p to become infinite, and let 

Jn = Wl + • • • 4“ Un> 

Then 

I U' - 1 g €, V g n. 

Thus ii) and iii) are established, and the proof is complete, except 
for the absolute convergence under ii). But this property appears at 
once on comparison with the double series of absolute values. 

The process of evaluating tlie given double series by means of 
the series S Un may be suggestively described as “summing by 
rows.” Since the terms in a double series may be rearranged at 
pleasure without affecting the convergence, it follows that the series 

uip • • • 

converges — denote its value by Vp — and furthermore the series 

1^1 4- Vo 4 • • • 

converges to the value U of the double series. This process may be 
suggestively described by the words: “summing by columns”. We 
may enunciate, then, the following theorem. 

Corollary, A convergent double series may be summed by 
columns as well as by rows. 
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Multiple Series in General, All of the foregoing definitions and 
theorems admit immediate generalization to multiple series, n "> 2: 

'V/Ix m2 ‘ 

where ntx^nu, • • in„ independently nm through the natural num- 
bers. 

Product of Two Series, Cauchy’s theorem relating to the pro- 
duct of tw'O series can now be proved with ease. I-et 

4- + * • • , 

t^i -f “h * * • 

be two absolutely convergent series. Denote their values by V, 
Then the product is represented by the following absolutely conver- 
gent series: 

^ ^ ^ + * * * 

Proof. Form the double series: 

UiVi U1V2 ^ • • • 

1/2 + ^2 + • • • 

This series converges. For, the series of absolute values : 

I Ml I 1 Vi I + I Ml 1 I t>2 I + • • • 

I Mo I I Vi I + I M2 1 I Vj I + • • • 


converges by the. Test for Convergence. 

Returning to the first series we see that the n-th row has tho 
value Un The series of values of the rows thus becomes: 

wi r -f W2 ^ + • • • , 

the value of which is U V. Now, this is also the value of the 
double series. On summing the double series diagonally, the product 
theorem results. 

Extension of the Theorem, It is not true that any two convergent 
series can be multiplied in this way, for the resulting series may 
diverge, as is shown by examples. Still, it is true that if the re- 
sulting series converges, it converges to the value that is the product 
of tlie values of the given series. For, form the power series ; 
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f{x) = lii X + M2 ^ + * • * 

^ (x) = Vj X -f Vo • 

By Abel’s Theorem, Chap. V, § 6, each converges uniformly in the 
closed interval 0 ^ x ^ 1; and now the same is true of the pro- 
duct series : 

/(x) (f (x) = Vi X^ -f (l/l V 2 + z/o ^ + • • • 

This proves the theorem. 

§ 5. Series of Series. Let a convergent series be given whose 
terms are sums : 

m m 

S -f • * • 

k=i T^\ 

Then this series can be written as the sum of m series : 

oo 00 oo 

2) 51 ’ 

n=r n=l n=l 

provided each of these latter series converges. In other words : 


m oo 


3) 


72=1 fel *=1 72=1 


Suppose, however, that the terms of the given series are infinite 
series : ^ 

4 ) 51 51 + * * * • 

test h=\ 

The analogue of the sum 2) is now the infinite series; 

oo oo 

5) X “J" + 

71=1 71=1 

and the question is; Will the series 5) be equal to the series 4) ? — 
provided, of course, that all the series involved converge. 

It clarifies the situation to formulate it as a double-limit ques- 
tion; Will oo oo oo oo 

6) S X ~ S S ’ 

72=1 772=1 7n=l 71=1 

That the convergence alone is not enough, is suggested by aU 
our experience with double limits and is proved by a simple example. 
Consider the double series for which 


^mn — 


n 
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where Smn denotes the sum of the terms in the first fn rows and the 
first 71 columns. The double limit on the left of 6) converges to the 
value 

lim Smn = 0. 

ni=x 

The double limit on the right of 6) converges to the value 

lim Smn = 1- 

71=00 

A sufficient condition for an affirmative answer is given by the 
following theorem. 

Tiif.orem. a stifjicient condition that the value of the infinite 
series whose terms are themselves infinite series: 

oo oo 

T “ml + y “m2 + • • • 

7W=1 

be given by the series of series t 

f “i„ + •••• 

7l=:l 7ml 

dU the series involved being convergent^ is that the double series: 

W|1 Ui2 4* Wj3 -b * • • 

^21 4 - 1^2 d " * 

^31 d" ^2 4- • * • 


converge. 

That the condition is not necessary, seems likely and is proved 
by the example: 

i-i 

the terms not lying in the two diagonals being all 0. The example 
is due to Mr. E. J. Moulton. 

Pons asinorum. At this stage of analysis writers and students 
are prone to a mistake that might seem to be an individual matter 
were it not for the facts of experience to the contrary. By a confu* 
sion of ideas the following theorem is developed: 
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“If the series which form the terms of 4) converge absolutlely, 
and if the series 4) converges absolutely, then the series 4) is equal 
to the series 5).” 

This theorem is false, as is shown by the following example due 
to Arndt: 


V. 2 2/V2 2 3 5/^V3 3 4 4/ 

I 2 2^/ V 2 2® 3 3®/ I 3 3^ 4 ' 4 , 27 '^ 

V 2 2®/ V 2 2* 3 3®/ ^ V 3 32 4 '43 7'^ 


Nevertheless, this false theorem is rediscovered by each new 
generation of students and writers, and there is no cure known to 
man. 

§6. Power Series. Theorem. Let f{y)he a futiction given 
by the poiver series: 

1) /(jr) = *0 + *ir + * 2 ^^ + • • •. — s < y < S-, 

and let ip (x) he a function given by the power series : 

2) ^ (a:) = fln + a: + ^2 + • • * * — R < X < R. 

Let — S <. Uq <. S, Let 

5) 7 "V 

where x is restricted to a certain neighborhood of the point x = 0. 
Thus 

4) /(r)=/f 

becomes a function of x in this neighborhood. 

Then the fwKtion f[<p {x) ] can he expressed as a power series 
in X, the coefficients of which are found as follows. Let each 
term in \) be expressed as a power series in x: 

5) = +4'*'x + ... 

and now let these power series be added as if they were pdLyno- 
mials : ^ ^ 

6) /[yU)] = «o"’ + * X “i"’ + “ 2 "’ + • • • 

TIobO /JessO 71—0 
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The proof by means of double series is immediate. Form the 
double series whose n-th row is the power series 5): 


^0 

0 

0 

bi Oq 

bi Ui X 

1 0 

by a^x^ • • • 

J ' 2 ) 

^0 

f*') 

1 X 

«2 ^ 


This double series converges. For, consider the power series 

8) I ^0 1 + I I X +U 2 I X=\x\. 

Denote its value by Y and form the power series: 

9 ) \bn \ r” = + Af' X + + • • • 


The double series whose n-th row is the series 9) converges, if X be 
suitably resticted, and 

^ 4”’. 

Hence 7) converges. 

A case of especial importance in practice is that in which 
^ = 0. The coefficients of x in the expansion are then series which 
break off with a finite number of terms. 


Example 1. Consider the function: 

1 

•j/ 1— + 

It can be represented by a power series in x, convergent throughout 
a certain interval. For, let 


Then 


fiy) = 


V \ - y 
y — <p (x) = 2 ft, X — x^ 


fij) = (1 — r)' 


1 + 


-2 r + + 


1 - 5-5 


2 - 4 -b 




The powers of y are here polynomials in x, and the coefiicients of 
the early terms in the expansion are readily computed. Let 


1 

•j/ 1 — 2 fL X x^ 


Pq (f*) + Pi (/i.) .3: + P 2 -h • • • 
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The coefficients Pn(f^) are known as Legendre's polynomials or Zo/i/zZ 
harmonics. We find at once: 

Poil^) = 1. Pi ((«•) = »*>. Pz ((»•) = 1(5 — 1), 

Pa (/») = i (5 /«.* — 3 It), Pi {it) = I (35 It* — 30 /t® +3). 

The example is unsatisfactory in two respects, and seems here- 
with to disparage the theorem. First, there is no indication how 
far the region of convergence of the series extends; and secx)ndly the 
law of the coefficients, i.e. the polynomial Pnifu) for an arbitrary /*, 
is not revealed by the theorem. True; but these are not questions 
the theorem undenook to settle. The theorem has given us the 
definition of the Pnif^) which lies nearest to the application of these 
functions, and moreover has provided us mth an extremely simple 
iiieans of computing the early ones. 

The example just discussed suggests the relation of the theorem 
to the Cauchy-Taylor Theorem in the theory of functions of a com- 
plex variable. The latter theorem tells us not only that the composite 
function can be developed into a power series, but it tells us also 
just how far that series converges, and it gives an explicit determina- 
tion of the coefficients. The advantage of the present theorem is, that 
it affords a more convenient means of finding the early coefficients, 
and sometimes the law of the series. 

It is not true in general that, if the terms of a series can be 
developed by Taylor’s Theorem, and if the function represented by 
the series can also be so developed, then the coefficients in the latter 
development can be obtained as in the theorem. For example, the 
function 

f(x) = jx 

can be developed into a Fourier’s series, Chap. VIII, §§ 1, 7, 8: 

sin X sin 5x , sin 5x _ 

nr 5 

and each term can be developed into a power series ; but the latter 
cannot be obtained by fonning the series of like powers of x. 
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Example 2. The function cot x, 

cot J - ^ ^ ~ ^ ~ ' 

sin jt X — ^ — • • • 


1 1 - 4 

j: 1 - J + X55** — • • • ■ 


Here, we can develop the function 

1 




by setting 

y = ix^ + •• 

and applying the geometric expansion : 

= 1 + -f + 


1-X 


Then multiply the two power series together. This sliows that there 
is an expansion of the form : 

cot X Uq + ai X ao x"^ + • * • ; 

X 


but there is a simpler way of obtaining tlie early coefficients. 

It is easy to show that the quotient of any two conviegent [X)wer 
series : 

ao + aix aostr + ^ ^ 

~T , L ^ 1 L , > t'o 

Do Di X + t?2 X -!-••• 

can be found by dividing the one series by the other just as if they 
were polynomials; cf. inf. Exs. 9-11. Appl 5 ^ing that method here 
we have : 








cot X = — 

X 


1 — ^ - jx X* 

1 — 5 + 2^ x"*-*-- 

1 — ^ X^ + x^O ■ 

— ^ X* — ... 

~ i x^ — • • • 

- ^5 r*— -- 

- i X - .r’ + • • • 


Hence 
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Exekcisi:s 

Compute the coeRicients in the following expansions through the 
term of the fifth or sixth dimension — or higher, if convenient. 

(* .in + . . .. 


log cosx. 


Suggestion : Set 


^ 2! 41 


log(l + 

(1 + x^)/{\ 4- ^ 


7. Show that 

log sin X — \ogx — ^x- — xg<5^^ 

8. Compute : 

V 8 ]o2 cns x 4- 8 — 8 cos :r + 

hm ^ . 

x=o 2 tan X — 2 sin x — or 


9. Show that the quotient of two convergent power series, 


^^0 4- g: 4- a j X- h f) 

^0 "h ^0 4" ^2 " d* * • • * ^ 

can be written as a power series : 

Co 4" ^ 4" ^2 x^ 4" * * * • 

10. Determine the coefficients Cn in Question 9 by setting 

0 4 - ^ 4 - «2 + ’ * * 

= (^0 + 4 - ^2 + • * • ) (^0 + + Co 4 - • • • ), 

multiplying out, and equating coefficients. 

11. Prove that the values of the Cq, Ci, C 2 , • • • as found in 
Question 10 are the same as those obtained by long division. 
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12. Let the terms of the series 


f [ -^ — -1 


be developed into power series in x: 

\ 1 _ X ^ X- 

a: + n n nr ri^ 


- 1 < X < 1. 


Show that the value of the given series is expressed by the series 

OO 4 OO 4 

+ 

71=1 " 


13. Show that the function represented by the series: 

sin X a^sin^x -y • * • ♦ 

where \ an\ < y” and y is a positive constant < 1, can be developed 
into a power series in x, 

14. Show that the function represented by the series 

Cj ysh X C 2 sh 2x + • • • , 

where the coefficients Cnare bounded, is analytic at the origin; cf. § 9. 

§7. Bernoulli’s Numbers. The coefficients in expansions 
like those considered in Chap. VI, § 5 admit simple expression in 
terms of a set of numbers defined as follows. Consider the function: 


2 - r 


It can be expressed as a power series, and since it is an even func- 
tion, only the terms of even degree will enter. Let us write, then, 


1 ) 


^ 1 

2 \ 




x^ 
^ ' 




,.0 


The coefficients 5^, B^, • • • are known as Bernoulli s Numbers, 

It is easy to obtain a recursion formula for computing the n. 
Equation 1) is equivalent to the following: 


X / X or 

2(2+7+.. +■ 


2! 


\ 
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On multiplying out and equating coefficients we find : 

A=\i 

1 -1 = 4- go 

2 ’nl (n + 1)1 2!(n - 1)! 4l(n - 3)! 


The sum on the right ends with 


(- l)‘‘+lg.a 


when n = 2/Ji + 1 ; 


The first few J5’s have the following values : 

Bi ~ I , ^2 — 'So* -^3 = » 

The Sum ^ rf. To find the sum of the r-th powers of the 
first n natural numbers : 


r + 2^ + • - + 


It is convenient to develop the formula for n — 1 instead of n. 


Let 

Then 






and 


On the other hand, 

e'^^- \ _ ^ - 1 X 

^ I X e^-l’ 

X _ ^ <r* + 1 X 

e' - 1 ■ 2 c' - 1 2 


X n r> T» 

— 1 — ~~ -p Bi — — 5.) — Bq — 

2 ^2! - 4! ^ 61 


Hence 


n^sc^ 


r- 


5! 


+ 


X ^2 

Aq Ax X + A 2 X^ + 


- f 1 — -|- -j- — • • • I 

^ 2 ^ 21 “ 4! ^ 61 J 


21 " 4! 

+ ArX^ + 
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We see, then, that 

On the other hand Ar can be computed by multiplying together 
the two power series and comparing the coefficients: 

^ ^ 1 ^ . 

(r-h 1)! 2 rl 2! {r - 1)1 

The final formula is: 


ir 4. 2 ''+ ... 4.(71- 1)'- = 


r + 1 




2! 




— — |'r(r — 1) {r — 2) n’ 


.r-3 


§ 8. The Development of cot x. From the development of 
Chap. VI, §5: 


1 ) 


rcotir:r = -+ ---] 

X L X 4* n n J 


it is possible to derive a development in terms of a power series, 
§7, Ex. 12: 


2 ) 


V QOXT X 


'T /I- 




On the other hand the cotangent can be expressed in the ccwn- 
plex domin as 

cos “Tx . 

r cot Tx = r = T i -j— ^ 

sin irx 


_ 2 irx + 1 

X 2 - 1 

This last expression is the basis of the definition of Bernoulli’s 
Nixmbers, § 7. Thus we find : 


3) 


. f r ^ i> (2 rx)- 


(2 txY 



Similar expansions hold for tanx, secx, cscx. 

The Series ~ . A comparison of the series 2) and 3) leads 
to an evaluation of the series of negative even powers of the integers. 
We have: 
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oo 


TZcsl 



1 


^ 1 _ 22^1 ir2/» p 

{2p)l 

§9. Analytic Functions of Several Variables. A func- 
tion of n variables, a:„), is said to be analytic in the point 

(ai, • • •, At,) if it can be developed into a power series : 

1) /(^li • • = S (:ri - a^)^^ * * • (:r„ - 

which converges for a point (£i,***£n) such that 

For simplicity, let n — 2 and write : 

2) J{x,y) = Coo 4- cio x + % y + xy + CooJ^ + • * * . 

If this series converges for a point (£,^), and if ^ ^ 0, ij ^ 0, then 
it evidently converges for all points {x,y) such that 

3) U|gU!, Irl^hl. 

If the coefficients are bounded, I Cmn 1 = O, then the series con- 
verges at least when 

4 ) \x\<U IjKl. 

The domain Of convergence of a power series in several variables 
is not simple. Thus the series 

1 -b xy -b x^y^ + -b • * • 
converges in every point {x, y) such that 

1 xy 1 < 1, 

and diverges for all other points. Hence the points of convergence 
are those which lie on the convex side of both hyperbolas : 

xy—i, xy= — 1, 

A point is said to be interior to the region of convergence 

if the series converges for a point 

I £ i -b a, !. 1 d* P 

where a, ^ are both positive. 
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If the series 2) converges in the point {x, r), then each of the 
series <» 

Crnn y" 

71=1 

converges, and 

72t=sl 71=1 

But the converse is not true ; the convergence of 5) does not 
insure the convergence of 2). 

A convergent power series can be differentiated term-by-term 
at any point interior to the region of convergence, and the derivative 
series will admit at least the same region of convergence as the 
original series. It follows, then, that the coefficients in a convergent 
power series are given by Maclaurin’s Theorem: 

6) fix, y) =/(0, 0) +/i (0, 0)x+f. (0, 0) j (0, 0) -h • • • . 

The theorem of § 7 admits immediate extension to power series 
in several variables. As a consequence we have the following im- 
portant property of power series. 

If is an interior point of the region of convergence of the 

power series 2), then f{xyy) can be represented by a convergent 
power series : 

fii + A. I + A) = A'" 

throughout a certain neighborhood of the point If follows, 

then, that if a function is anal)rtic at a point, it is analytic at every 
interior point of the region of convergence of the series. The domain 
of definition of the function may now be extended by the process of 
analytic continuation familiar in the theory of functions of one and 
of several complex variables. 

Taylor’s Theorcxm for an arbitrary interior point of the region 
of convergence of the power series now follows at once: 

f (^. r) =/ Oro. Xo) + fio i^o, Xo) ix - Xo) + /oi (j^o. Jo) ix “ Xo) 

1 2 

+ (^0. Xo) + ^/ii (xo,Xo) (x - Xq) (y - y^) 

+ ^/o2 {xo, Xo) ix-Xo)^+ • • • • 
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Analytic Curve, Surface, etc. A curve : 

xjc = 1, • • n, 

is said to be analytic at a point * * * , if each of the func- 
tions Xk (t) is analytic at the point t — tQ and x^ = Xf^it^); and if, 
furthermore, not all the derivatives x'^ (t) vanish there. An arc of 
a curve is said to be analytic if it is analytic at each of its points. 
A surface : 

Xf^ — ■ (^1 ^ L ’ ‘ i n, 

is said to be analytic at a point (a:i, • • * , x^) ^^ch of the func- 

tions Xk {u, v) is anal 3 rtic at the point [uq, and x\ — xj^ (wq, i;q) ; 
and if, moreover, the rank of the matrix 


dxi 

. dx„ 

du 

du 

dxi 


dv 

dv 


at Vq) is 2. A piece of surface is said to be analytic if it is 
analytic at each of its points. 

The extension of the definition to manifolds of higher order is 
obvious. 


Exercises 

1. Let ^ 

M = — 

r 


= {x — af + {y — bf 4- (.2 — cf, 

{a, b, c) ^ (0, 0, 0), r > 0. Show that the function u is analytic 
in the origin. 


2. Let 

be analytic in the origin. 


M =/U, y, z) 
Then 


f{x, y, z) = i<o(x, y, z) + u, {x, y, z) + • • 

where u„ (x, y, z) is n homogeneous polynomial of degree n, or is 0. 
Furthermore, let u be harmonic : 

d^u d^u , d^u 
dx^ df- ^ ■ 

Show that Un{x,y,z) is harmonic. 
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§10, Resfular Curves. Jordan Curves. We have defined 

analytic curves, and now mathematical perspective demands some 
mention of the more general concept of curve^ even though a detailed 
analytical developement. of these ideas lies outside the frame of these 
Lectures. 

Let 

1) ^=/(0. j = ?’(0. 
where f {t), (p{t) are continuous in the closed interval 

2) 0 ^ t ^ 1. 

Under suitable further restrictions Equations 1) will represent a 
cur\'e in the [x, y) - plane. Ijet us first, however, consider the pos- 
sibilities when no further restrictions are imposed. 

a) The point set } {:c, y) j defined by 1) may consist of a 
single point. This is the case when f {t), (f {t) are both constants. 

b) At the other extreme, the point set { yj | defined by 1) 
may fill a two-dimensional region of the (x, y) - plane. Peano has 
given an example in which every point of a square in the {x, y) - 
plane belongs to the point set j (jr, y) \. It is only fair to say, how- 
ever, that the transformation of the interval 1) on the square is not 
one-to-one. Some points of the square are obtained more than once. 

In each of these examples the transformation of the points of the 
interval 2) on the elements of the point set j [x, y) } defined by 1) 
has failed to be one-to-one. Let us, then, with Jordan, seize on this 
requirement as the further restriction to be impqsed on the functions 
f {t), ip (^) and say : If j/, y^ are any two numbers such that the 

equations 

3) y = (p{t) 

admit a common root t = where 0 <. <. 1, then these equa- 
tions 3) shall admit no further root t = where 0 ^ ^ 1. 

Such a point set { {x, y) } is known as a Jordan curve. If, in 
particular, 

4) /(0)=/(l), 9?(0) = 9?(1), 

the curve is closed, and it is a fundamental theorem of analysis 
situs that such a curve divides the plane into an interior region and 
an exterior region. 

But if Equations 4) are not both true, the end points of the 
curve are distinct, and we have an open curve. The curve is simple^ 
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i. e. has no multiple points. For otherwise the equations 5) would 
admit two distinct solutions, and in the closed interval 2). 

Returning to the case of a closed curve we observe that there is 
a one-to-one and continuous relation between the points of such a 
curve and the points of a circle. 

4 Jordan curve may fail to have a tangant at each and every 
pqint. Moreover, there is another important property which it fails 
to share with the curves we ordinarily think of, like arcs of ellipses, 
cycloids, etc. or even arbitrar}^ analytic arcs (or regular arcs, cf. 
infra). Any one of these latter arcs can be embedded in a two- 
dimensional region of arbitrarily small area. But it may be impos- 
sible to enclose a Jordan curve in a two-dimensional open set, the 
area of which is less than an arbitrary positive quantity — even when 
the “area” is measured in the sense of Lebesgue. 

Regular Curves. Consider an open Jordan curve. Impose on 
^(f)» the still further restrictions that each of these functions 
possess a continuous first derivative in the closed interval 2). Such 
a Jordan curve is defined as an arc of a regular curve, or as a 
regular arc. 

A regular curve is now defined as the point set made up by 
stringing together a finite number of regular arcs, C 2 , • • • , ; 

the terminal point of Ck coinciding with the initial point of C;fe+i, 
k = \, 2, - •, 71 - 1 . 

A regular cuive may be open or closed. It is not necessarily 
simple. It may have a whole arc of multiple points. Or it may 
have an infinite number of multiple points, all but one of which 
are isolated ; e. g. ^ 

/ r = 07^ sin — , 0 < a: ^ 1 ; 

^ jy = 0, a: = 0, 
is a regular .arc, -and 

jr = 0, 0 ^ ^ 1, 

is another. Together they make up a regular curve. 

Exfrcise 

Show that a point set { {x, y) | consisting in part of a two- 
dimensional open set can never be mapped in a one-to-one manner 
and continuously on a line segment, 2). 



Chapter VIII 
Fourier's Series 


§ 1. Fourier's Series. By a trigonometric or Fourier^ s series 
is meant a series of the form : 


1 ) 


(^71 COS nx -4- bn sin nx). 


/i=l 


If the series converges and, after being multiplied by cos kx or 
sin kx, can be integrated term by term, it is easy to determine the 
coefficients. Observe the formulas of integration : 


71 

s 


$m m X oos n X dx = 0 ; 


f 

/■ 


sin mx sin nx dx = 


0, m ^ n ; m = n. 


cos mx cos nx dx = 


Thus vve find, on denoting the value of the series by J (:r) : 


2 ) 



cos nxdxy 



sin nxdx. 


These numbers, an and are knovm as the FourieFs Coef- 
ficients of the function f{x). They have a meaning for any contin- 
uous function, and for a great variety of discontinuous functions, aside 
altogether from the problem of whether the function can be developed 
into a Fourier’s series or not. Let us study some of their properties. 

We shall restrict ourselves to functions f {x) which are continuous 
in the interval {•— ir, ir) except at most at a finite number of points, 
Ti, ’ • *, cf. figure on next page. Within each interval (:rjt, oth-i) 
the function shall have a continuous derivative, and both function 
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and derivative shall approach limits at each extremity of the sub- 
interval. In a point 





where 

/ (c+) = lim / (ar), /(c~) = litn / {x). 

jte=c4- x=cr' 

Moi-eover, 

/(,) = il /(-^+)+/(0 s . 

Thus f {x) is defined in the interval — r < :c = t. For all 
other values of x it shall be defined by the requirement of periodicity : 

f{x^r 2ir) =f{x). 

We shall prove in §§ 7» 8 that such a function can be developed 
into a Fourier’s series. 
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2. Let f {x) be defined as follows : 

/(x) = 1, 0 < X < r ; 

y* (x) = — 1 , — r < X < 0 ; 

/(0) = 0, /(ir)=:0; 

/(x 4- 2r) =/(x). 




Show that, if f (x) can be developed, 

r ( ^ / sin X , sin 5x , sin 5x , \ 

5. Ify{x) ls an even function: 

fi-^x)^f(x\ 

show that only the cosine terms will appear: 

/(x) = — + X cos 7ZX, an=^ — I fix) cos nxdj^ \ 

2 »• 

and ify(x) is an odd function: 
only the sine terms will appear: 

?r 

y (x) = ^ hn sin 7ZX, W — — I f (x) sin nx dx. 

;,=i ^ ^ 

4. If fix) is defined merely in the interval 

0 ^ X S IT, 

show that y (x) can be developed into a sine series, and also that 
fix) can be developed into a cosine series. 

5. Ify(x) is defined merely in the inten'al 

0 X ^ T, 

and if 

f{r—x) —fix), 
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show that, if f {x) be developed into a cosine series or a sine series, 
aniy alternate terms will appear: 

a ^ 

/ (•^) = -77 + 2 ^ ^Z 27 i cos 2nx, 

^ /z=l 


/ W = X ^ 2 n-i sin ( 2 rt — 1 ) X. 

n=l 

6 . Assuming that the function 

f (:r) = cos (X x 

can be developed into a Fourier’s series, convergent in the interval 
— ir ^ a: ^ IT, show that 


sinairf 1 2 a cos cos njcl 

\(j.x = I — + > 2 o I* 

T La — n‘^ J 


«=sl 


On setting or = ir the development becomes : 

1 . 2 a 

Changing the notation, we have the development : 


sin ar f ^ ^ 2 a l 

;ocir = { — + y — 2 ^ 


TT cot TT 


1 


^ = - + X--— 2- 

^ ;Sl ^ 


§2. Bessels Inequality. Normal Functions. Let Co(x), 
5^1 <Pn be a set of functions, each continuous in a closed 

interval a ^ x ^ b, and such that 
h 

^ <fm {jo) <pn {x) dx — 0 , m ^ 71 . 

a 

Vloreover, they shall be linearly independent. Such a system is 
called a set of orthogonal functions. As an example : 


~ ^2n (^) = cos UV, f2n-l M 


It is in terms of orthogonal functions that the most important 
levelopments of mathematical physics take place : 

f{x) — Co^oix) + Cl ipi (x) + • • •. 


S) 
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If such a development is possible, and if on multiplying through 
by (pn{x) it is possible to integrate term by term, the coefficients 
will be given by the formula : 

7. 

f{x)<Pn{x)dx 


6 ) 




Cn- — 


S 


i<fn {x)Ydx 


Observe that the denominator cannot vanish, since no function 
can vanish identically. 

If ipQ{x), .• • • is any set of orthogonal functions, then 

ao (To {x), a^i c i {x)y • • • , where the anS are any positive constants, is 
also an orthogonal system. It is obvious that the can be so chosen 
that 7 , 

7) 


J* [<fn{x)fdx = i. 


The modified set of functions is said to be normalizecL Thus the set ; 


8 ) 


V 2ir y TT 

is an example of a normal system. Equation 6) then becomes: 


— cjbsnx. 


1 


: sm nx^ 


T < X < 


9) 


Cn — J* f U) Tn W 


Approximation by a Normal Polynomial, How can we use 
the n coefficients Cj^ most advantageously, in order best to approximate 
to a given function, f ix), by a polynomial of normal functions, 

10) Cu U) + q f 1 (:r) + • • • 4- Cn-i (^) ? 

The question can, of course, be answered in many ways. One 
of the most useful answers is that given by Bessel, who used the 
idea of Least Squares and de.manded that the Cf^s be so determined 
as to make the integral of the square of the error: 

h 

U= J [fix) — Co (fo (.r) — • • • — Cn-I (fn-i (^c) ? dx 
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a miniinutn. A necessary condition for a minimum is, that 

h 

~~^J “ <^0 fo Cn-1 ^^71-1 ] <fk = 0. 

a 

Since the {x) form a normal set, this equation reduces to the 
following : 

11) Ck = J Vk i^) dx. 

a 

These are the same values as those given by 9), and further- 
more it is to be noted that a given Cj^ does not change as n increases. 

If these values be substitued in the integral, the latter reduces 
to ^ 

J' [/ ix) ]-dx - CJ - Cl - • • • - c*_i . 

a 

But the integral is never negative, and so we arrive at BesseVs 
Inequality : 

h 

12) cl+c\+ ■■■ + cU ^ J [fU) ]-dx. 

a 

From 12) w'e infer that the series 

13) cj ••• 

converges. In particular, we see that the series formed from the 
squares of the Fourier’s coefficients converge: 

( ^0 "h -F ^2 "F ’ * ‘ 

14) j 

+ • • • 


Exkrusi-s 


1. Let (p(x) be continuous in the closed interval a S x ^ b. 
Show that each of the integrals 


h 

J" v’W 


cos nx dXf 


^ if (x) sin nj 


approaches the limit 0 as n bec'omes infinite. 

Suggestion. Begin with the case that a = — ir, = r. 
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2. Extend the theorem of Question 1 to the case that ip (x) is 
continuous in the above closed interval except for a finite number of 
points, and if (x) is absolutely integrable; i. e. the integral 


j I <f (-r) 1 


converges. 

Suggestion. Isolate the points of discontinuity by arbitrarily small 
neighborhoods. Show that the contribution of these neighborhoods 
is uniformly small for all values of n. Then apply the theorem of 
Question 1 to each of the remaining intervals. 

3. If if (x) satisfies the conditions of Question 2, show that 


lim I ^ (x) sin (n + i) = 0. 

Tj=oo 


§3. Appraisal of the Fourier’s Coefficients. If a func- 
tion /'{x) of the class here considered (§ 1) has no discontinuities, 
the series 

I ^0 -f fli + ^2 + * * ‘ 

( Z,, + . . . 

converge absolutely, and so the Fourier’s series converges absolutely 
and uniformly for all values of x. 

The proof is as follows. Transform the integrals in 2) by in- 
tegration by parts. Since y(x) is continuous and periodic, we find : 

j f {x) cos nxdx= ^ f*[x)smnxdx 

—71 —It 

16 ) ( 71 It 

^ f [x) smnx dx — — ^ {x)cos?ix dx. 

— .1 -7C 

Let the Fourier’s coefficients of the function /' (x) be denoted 
by primes: 

17) a!, = -- J* f (x) cos nx dx, ^ **** 
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Thus the relations 16) can be written in the form: 

18) Clji — , bn — . , 

n n 

We cannot integrate again b}'' parts without making requirements 
respecting the second derivative of f {x). We can, however, attain 
our ends by means of an algebraic device. It is obvious that 


Hence 




S + 


But the series 


b'{ + hf + 


converges by §2, 14); and the series 

1 1 

72 + ^2 + ••• 

also converges. From 18), then, 

2 1 I g il- + 2 

and hence the first of the series 15) converges absolutely. — The 
convergence of the - second series is shown in a similar manner. 

§4. Identical Vanishing. VVe come now to a theorem which 
is proved with equal ease for a more general class of functions than 
that of § 1. 

Till:- Ri.M. Let ip{x) be continuous in the interval 
— ir <. X ^ IT, 

except at most for a finite number of points; and let the function 
be bounded. Let all the Fourier’s coefficients vanish: 

^ <f {x) cos nx dx = 0, ^ <f (x) sin nx dx — 0, 


Then (p (x) = 0, except in the points of discontinuity. 

Proof. If the theorem is not true, let = X be an interior 
point of the interval, in which ^{x) is continuous and ^ 0; — posi- 
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tive, say : ^ (X) > 0. Then there exists an interval {a, b) : 

T<.a^x^b<T, 

where 

\ _a + b 

such that ^ (.r) is positive throughout (a, b), and is, therefore, greater 
than a certain positive constant, M: 

M < f{x), a ^ X ^ b» 


Let hi < t/2 be so chosen that the interval ] — X j ^ Aj 

lies in (a, A), and choose 0 < h <. hi. Form the function 


C (x) = y -f cos :r 



and determine y so that 

C(A) = 1, 

or 

y = 1 — cos h. 

Then C {x) has these two properties : 

i) 1 ^ \x\ < h; 


ii) — r S C (x) g r, 

— ^ :r = — Ai, hi ^ X ^ T, 

where r is the larger of the two constants 1 ~y and C(Ai), and 
hence 0 < r < 1. 

And now we apply this function as follows. Let 
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where n = 2m is an even natural number. If m is chosen large 
enough, the value of this integral will be positive. For, the integral 
can be written as : 


J <p{x) y", 


t.—ni 7 ; 

- / 

-.1 ).4-/ri 

The first integral is greater than 


J‘ <p{x)f'd. 


X > 2 M h 


for all values of m. 

Let G be the upper limit of \*p{x) | in the interval (— ir, r). 
Furthermore, if € >0 is arbitrarily chosen, m can then be so 
determined that r” < €, and consequently 

y" < (., or \ + x ^ v. 

Hence the second and third integrals, taken together, are less than 

2 IT G €, 

Thus 


J 


d X > 2 xV//^ — 2 IT G €. 


Lei € be so chosen that the right hand side is positive. 
Here is a contradiction, for 


^ ^ dx ^ 0 

for all values of n. In fact, 

y* = [ y 4- cos (j; — X) ]'* 

can be written as a polynomial in sin a:, cost, and then converted 
into a trigonometric polynomial, cf. § 5 : 

n 

y* == ^ {Ak cos -f Bk sin k x). 


Hence 
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^ <p (x) dx = I ^ (p{x) COS kxdx 


+ Bk ^ if {x) sin kx dx J . 


But the Fourier’s coefficients of if (or) ail vanish by hypothesis. — This 
rx)mpletes the proof. 

§5. The Formulas of Summation. The following for- 
mulas of summation are especially useful in the study of Fourier’s 
series. 


f 


A) 


7 } 4- cos ^ + cos 2 ^ -f • • • + cos n ^ 


sin <p 4 - sin 2^4* * * * 4" sin n<p = 


. 2/2 4 “ 1 
sm — — if 

2sin-|- 

ip 2w 4- 1 
cos|:-cos— — y 

2 sin 


B) 


V 4 - cos ^ -h cos 2 ^ 4* * • • 4” cos n ^ = 


sin ^ 4“ sin 2 ^ 4* • • 4- sin n ^ = 


cos nc ~ cos (n 4- 1 ) ^ 

2 (1 — cos^) 

sincT 4- sin nc — sin (n 4- 1 
2(1 — cos^) 

These formulas can be deduced most expeditiously by the aid of 
complex quantities from the geometric progression : 

i + ■■■ = . 

~ 1 

They can, however, once given, be established by the method of 
mathematical induction. 

Similar formulas for 

cos ^ * cos 2 ^ 4" cos 3 ^ — • • • 
sin ^ — sin 2 ^ -1- sin 3 ^ — • • • 

can be obtained by replacing by ^ The denominator will 

be 2 cos I or 2 ( 1 4 - cos f). 
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Other Formulas of Trigonometry, We mention de Moivre’s 
Theorem : 

f' jn m(m— 1) • 2 

cos m ip = cos’” ip \2 — " ^ ^ 

m{m—\){m — 2){m—'b) , . , 

+ 1 -2-3- ' 4 ^cos'"-*^ sinV + • • • 

m-1 • m (m— 1) (m--2) . o 

smmip — m cos’” ^ ^ sm ^ ^ cos’” ^ if sin*^ <p 

1 * 2 ' o 


C) 




proved most easily by expanding the binomial on the right of the 
equation 

= (cos (p i sin 


and equating coefficients ; also by mathematical induction. 
Furthermore, a quasi inverse : 

m 

D) cos^ X sin^ ^ ~ ^ cos ^ .r + Bk sin kx), p q ^ m. 

This formula is likewise readily established by induction. 


Exercises 

1 . Prove that 

I X . . / A\ sin 2 72 c? 

cos ^ + cos 5 ^ -b • • • + cos (,2 72 — 1) ^ = — , 

2 sin^ 

sin ^ 4- sin 5 + • • • + sin (2 72 — 1 ) ^ = , 

2 sin^ 

2. Obtain formulas for 

cos ^ — cos 3^ + • • • -I- (— ly^'^'^COS (272 — 1)^, 

sinp — sin 3^ + • • • -f (— sin (2 72 — l) <p. 

Suggestion: Write the odd numbers as 4^ + 1 and 4^ — 1. 

3. Prove that 

(a cos a: + P sin a: + y)'” 
can be written in the form: 

m 

V (Akcoskx + Bksiakx), 

Si 
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§6. AbeFs Theorem. If the cxDefficients of a Fourier’s series 
form a series that converges absolutely, then the Fourier’s series con- 
verges uniformly for all values of a:, as is seen from Weierstrass’s 
M-Test. In the case of certain other important Fourier’s series, the 
uniform convergence can be established by Abel’s theorem, Chap. V, 
§ 6. Let dit 0 - 2 , * • • be any set of numbers such that 


Oil ^ 0 i 2 ^ (ts ^ , lim = 0. 

»=:30 

Then the series 

sin ^ -h a 2 sin 2 ^ -h • • • 

converges uniformly in any interval («, Z>) which with its extremities 
lies inside the interval 0 < < 2 ir : 

0 <. a ^ X ^ b 2v, 

We wish to prove that, to a positive € chosen at pleasure, there 
corresponds an m independent of ip such that 

I am+i sin (m -h 1) * -h (^m+p sin {m + p)^ \ < €, 


Now, by §5, A): 

sin (m -h 1 ) ^ -f- sin (m -f 2) ^ -b • • • + sin {m + p)<p 
2/71 4-5 2r774-2u'bl 

i in — mfi -jC ( 


COS- 


ip — cos - 


2 


■9 


and so 


2sin- 


^ ^ sin + 1) ^ -b * • • *f sin (^71 -b ^ = — — 


sin|- 


sin-^ 


for all values of p. If, then, w^e choose c as any positive quan- 
tity < V, we shall have 

^ ^ sin (m + 1 ) ^ + • • * + sin ( w -b ^ ^ — - — , 


. c 
sm- 


sin- 


c^^ = 2t — c. 


Hence by Abel’s theorem 


— 2i 2!±L g ctm+i sin (m -b l)f + * • • + (^m^p sin (m + ;?) = * 

sin-l an-| 
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c ^ tp = 2 — c, 

and so it is sufficient to choose m so that 


The same theorem holds for the series 

oti cos ^ 4- ^'2 cos 2 ^ + • • • . 

A similar theorem holds for the series 

ai cos ^ — (X 2 cos 2 ^ 4- 03 cos 3 ^ — • • • 

and 

Oi sin ^ — O 2 sin 2 ^ + O 3 sin 3 ^ — • • • 

the interval {a^h) of uniform convergence now lying within the in- 
terval (~ r, y): 

'-T<,a^x0b<,T, 


Blxamples, 


sin ip , sin 2 ^ , sin 3 ^ , 
1 2 3 


cos^ cos 2 ip , cos3^j^ 

12’^ "T^ “*■ 


Exercises 


1 . Prove that the series 


sin X . sin 3x sin 5ar , 
1 3 5 


converges uniformJy in any interval 


2. State and prove a similar theorem for the series: 

cos a: , cos3ar , cos 5a: , 

— + -3- + -T-+'"- 
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§ 7. Proof of Converg'ence. We have stated in § 1 the 

theorem that the Fourier’s series corresponding to a function /(j:) 
of the class there defined, converges for all values of the argument 
and represents the function ; i. e. the value of the series is equal, for 
each a:, to the value of the function. We will now prove that 
theorem. Begin with the case of no discontinuities Then 

the Fourier’s series converges uniformly for all values of x (§ 3) and 
so represents a continuous function. 


1) 


F(x) ^ S cos n X bn sin n x ) . 

2 ^ 


71=1 


The Fourier’s coefficients of this function can actually be obtained 
by the method suggested at the beginning of § 1, and so we have: 
t: tt 

2) an = I F{x) COS71X dxy bn — — I F{x)smnxdx\ 

TT d T d 


i. e. the Fourier’s coefficients of the functions fix) and F(x) are 
identical. 

Form the function : 

W =/U) ~ •P’W- 

This is also a function of the class defined in § 1, and it is cnntinu- 
ous without exception. Its Fourier’s coefficients are all 0. Hence by 
§4 it is 0 for all values of x, and the functions fix). Fix) are 
seen to be identical: 


3) 


fix) = “7 
2 


Thus the theorem is proved for continuous functions. 

§8* Continuation, The Discontinuous Case, A Special 
Function, The proof of § 7 justifies the development of § 1 , Exercise 
1. But we can go a step further and establish the development of 
Exercise 2. For, the first series can be differentiated term by term, 
by the theorem of Chap. V, § 9, at all points at which fix) has a 
derivative. In fao , let Xq be any point of the interval 0 < :r < t 
or — IT <C a: < 0. It is then possible to include xq within an 
interval ia, b) which, with its end points, lies within the interval in 
question: 
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^T<,a<.XQ<,b<,0 or Q<,a<^XQ<.h<,T, 
Within this interval the series 

sin X . sin 3 j: , sin 5:r , 

— + -3- + — 3- + ••• 

converges uniformly; cf. §6, Exercise 1. The other conditions for 
differentiation term-by-term are satisfied, and thus the developement 
of Ex. 2 is obtained. 

Oscillation of f{x) at a Point of Discontinuity. Let 
D=/(c+)-/(c-). 

Then D is the oscillation ol f {x) at the point c. 

I.et 

« / ^ 2 r sin :r . sin 5:r , sin ^x , 1 

Then 

$ (or) = 0 < a: < r ; 

^ (:r) — “T < a: < 0. 

Thus the oscillation of $ (x) at :c = 0 is 1. 

Form the function : 

fix) - D^ix- c\ 

where is a function of the class defined in. § 1, and D is its 

oscillation at c. This function also belongs to that class of functions, 
and its oscillation at c is 0; i.e. it is continuous there. 

Let the discontinuities of f [x) in the interval — -r <. x ^ t 
lie in the points 

— T < Cl < Co < • * * < Cn = ^ 
and let the oscillation in Cj^ be D;^. Then the function 

^ Ok ^ {x — Ck) 
i=l 

will be continuous for all values of x, and also belong to the class 
of functions defined in § 1. It can, therefore, be expanded into a 
Fourier’s series, absolutely and uniformly convergent to the function 
for all values of x. 
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The function $ (x — c) can also be expanded into a Fourier’s 
series whose general term is 

sin {2n — l)(.r — c) __ 

2 / 1-1 "" 


sin (2/2 — l)c _ , cos( 2/2— t)c . .v 

~~ 2n ~ — i — ^ ;-^sm(2/i— l)x, 


2 / 1—1 


and we know all about the uniform convergence of this series. 

We see, then, that the original function f {x) can be expanded, 
and the proof is complete. 

We remark that the Fourier’s expansion of the function, 

/ (x) = — ■ + 'V (a„ cos nx + b„ sin nx), 

2 

n=:l 


can be broken up into the series 

eo eo 

^ an cos / 2 X, ^ bn sin nx. 

rtsssl ntssi 

For, 

/(— x) = — + V (a„cos nx — b„ sin nx), 

ns=*l 

and the two series can be added and subtracted. 

The same result might have been obtained by observing that 
any function f (x) of § 1 can be written as the sum of an even and 
an odd function : 


fix) = ilfix) +/(- x)] + ^ [fix) -/(- x)l 

Each of these functions can be developed into a Fourier’s series. 
The first development will contain only cosines, the second only sines. 

One further remark. A function f{x) of the class here con- 
sidered may vanish identically throughout any subinterval of the 
interval v); but its Fourier’s coefficients will all vanish if 

and only if the entire interval is made up of a finite number of 
such subintervals and their end points ; i.e. f (x) s 0. 

§9. The Gibbs Effect. When the Fourier’s development 
represents a discontinuous function, the series cannot converge uni- 
formly, since the terms are conunuous. One might expect the 
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approximation curves to proceed fairly directly, as in the case of 

_j 

lim X . 

71=00 

On the other hand, they might rise to indefinite heights, as in the 
case of 

lim nxe~~^^^- 

71=00 

They do neither. The function (x) is bounded, but the graph 
rises appreciably above, and drops appreciably below, the graph of 
the limiting function near the point of discontinuity. This is the 
phenomenon which Gibbs first pointed out, and which Bdcher was 
the first to treat maihematically*. We turn now to a detailed study 
of the phenomenon, following Bocher’s methods, but using a slightly 
different series**. 

We have seen that the function 


1) 

has the value : 


r/ \ sin X , sin 3x , 

/(x) = — + — 


Jir, 2 mr <, X <. {2 n T 

y (x) ~ ^ — -J TT, (2 n — 1 ) TT < X < 2 mr 

0, X = riT 

We wish to study the approximation curves and, in particular, 
to show that they remain finite. Let 


\ sin X , sin 3x , 

2) 571 (^) = -y- + ^ ’ 

Then 


sin {2n — 1 ) x 


2n — 1 


3) Sn (x) = cos X + cos 3x -h • • • -4- cos (2 /z —• 1 ) x = ^ 


s in 2 X 
2 sinx 


Because of symmetry it is sufficient to study the function in the 


interval 
We have : 


0 g X g 


• Gibbs, Nature^ vol. 59, 1899, p. 606. Bocher, Annals of Mathematics^ 2d. 
ter., vol 7 (1906) p. 123. 

•• This is the series used by Carsiaw, Fourier*s Series and Integrals, On 
p. 273 there is a carefully drawn graph of the approximation curve for a 
particular value of n. 
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4) 



sin2rt:c , 

dx. 

2 sin X 


This integral can be transformed as follows. Write : 


where 


1 

sin X 


1 

X 


+ 2srU), 


5) 


2c(x) = ^ 
Sin X 


1 

X 


X — sin X 
X sin X 


0 < ^ g 


TT 
0 ■ 


Moreover, we deline 


<p (0) = lim <p (x) =■ 0. 
x=o+ 


Thus (x), together with its derivatives, is continuous in the closed 
inteiwal 0 ^ x ^ | . 

We can now write : 

X X 

6) Snir) = ^ ^ (p{x)%\xi2rLX dx. 

0 0 

The second of these integrals can be appraised by integration by 
parts. Thus 

X X 

f if (x) sin2 nx dx = — C {x) cos 2 nxdx, 

%j In 2n%J ‘ 


Denote the value of this integral by : 

X 

^(a',n) = ^ if{x)^\x\2nxdx. 

0 

Let yi be the maximum value of | (p{x) |, ] <p^ {x) [ in the interval. 
Then 

7) ' 'if (x,n)\ ^ , G = (^ + i :r) M, 0 g .r S f. 

n 

Hence 

8) .„(.r) = r +❖, 0<:rgf. 

J 2x n 

This latter integral can be thrown into more transparent form 
by a change of variable^ Set 
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9) 

Then 

L 

2nx = t. X = — . 

2n 

10) 

r sin 2«.r rsinf^^ 

« / 2 .2: 2 ^ t 

0 0 

This integral 

converges when t — oo. It is, in fact, well known 

that 

oo 

11) 



0 


but we do not need the quantitative result to establish the truth of 
our statement, that the function Snix) is bounded. That proof is 
now complete, since 

t 

12) s„ix) = + 'if, 

0 

and each of these functions is bounded. 

Remark. The reader who is interested in following the quantita- 
tive relations more closely, can readily do so. The ordinates of the 
curve 

13) y=s„{x) 

can be appraised with an absolute error of less than any preassigned 
positive € for large values of n as follows. First, determine m so that 

m 


Then the ordinates wall be given to the degree of accuracy in ques 
tion by the integral 


a? t. 



0 0 


In particular, the maxima and uiinima of the curve 15; aie 
given by the roots of the function 
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In any case, xk = . Thus 

2n 

k'l 






U 2x J 

0 0 

t 


• 2ir 3^ 



■■ 

+ / 


0 1C 2:i 

(A-l)ic 

The terms in this 

sum are alternately positive and negative, and 

steadily decreasing 

in numerical value, 

so that the sum can be 


written in the form : 

^0 — 4 - — 1^3 + * • * 

The values of the early VnS are found to be*: 

Vq = 1.852 = 0.142 

0.434 i;5 = 0.116 

1^2 = 0,257 = 0.098 

=0.183 

§10. Integration and Differentiation of the Expansion. 

The series arising from the Fourier’s expainsion of any function of the 
class defined in § 1 can be integrated term by term throughout any 
finite interval. This is obvious when there are no discontinuities, 
for then the series converges unifor<nly for all values of x, and the 
terms are continuous. But even when discontinuities are present, 
integration term by term is possible in any interval which does not 
contain or abut on a singularity; for in such an interval the con- 
vergence is uniform, and the terms are always continuous. Moreover 
the function 

Sn {^) S cos nx bn sin nx) 

is bounded. If, then, the points of discontinuity which lie in an 

* cf. Bochcr, 1. c., p. 129, where further references are given. — The details 
of the study here outlined are given by Carslaw, 1. c. 
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interval of length 2ir be excluded from the interval by arbitrarily 
small neighborhoods, the contribution of these neighborhoods both 
to the integral of the function and to the integral of the remainder 
r„ (x) of the series : 

fix) = Srt (x) -f r„ (x), 
will be small, and hence 



or the integral of the series is equal to the .series of the integrals. 
— It is left to the student to put this proof into €-form. 

Differentiation, If f{x) is a continuous function of the class 
defined in § 1, and if its derivative also belongs to this class, then 
the Fourier’s series which represents f{x) can be differentiated term 
by term. For, the derivative {x) can be developed into a Fourier’s 
series, and this series can be integrated term by term. The latter 
series is a Fourier’s development for f{x). But the Fourier’s develop- 
ment of f{x) is unique. 

A repeated application of this result enables us to establish the 
following more general theorem. 

Tjiforem. Iff{x) and its derivatives of the first n orders 
are all functions of the class defined in § 1, and if f{x) and its 
first n — 1 derivatives are contmuous for all values of x^ then the 
Fourier s expansion of f{x) can be differentiated n times term by 
term, 

Bocher has obtained a number of more general theorems relating 
to differentiation term by term, as well as to the development into 
a convergent Fourier’s series, in the article c ited in § 9. This article 
is of elementary character and affords an important supplement to 
the tj-eatment here given. It is based on Poisson’s Integral, the 
analytic treatment of which was subsequently simplified, without 
however, thanks to a remark of Professor Perkins,, losing the advan- 
tage of a simple geometric interpretation of the convergence on the 
boundary*. 


•cf. the Author’s Funktianentheorie^ vol. I, 5th ed. 1928, p. 669. 
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§ 11. Divergent Series. In the ancient days of modern 
science inatheriiaticians operated with divergent series with a naivete 
vvliich lost much of its charm when the more serious requirements 
of convergence became central in the tliought of the age. Let us 
turn back for a monjent and see what were some of the things they 
did. 

Consider the series 

1 ) 1 ~ 1 4 - 1 - 1 + ••• 

It is no use to sum the first n terms (the men of that time never 
did! ). But this series mast have a meaning — so simple a series as 
that cannot be a no-body. Let us call its value x : 

Well, now we see that 

Ah ha ! 

X = \ Xy 

a: = i. 

I told you it had a meaning, and there it is : 

But you are not convinced by my logic ? How banal ! How- 
ever, to humor you, I’ll give another proof. You admit with all 
your modem sopliistication that 

-7—7 = 1 — a: -f a:- ~ -f • • • 0 < .r < 1. 

1 4- a: 

And you believe in limits. Very well. Let x approach 1 as 
its limit. You see now, do you not, that tlie left-hand side of this 
equation approaches the limit J — even Weierstrass would have 
admitted so much. And every school teacher knows that “if two 
variables are always equal and eacli approaches a limit, the limits 
are equal’’. So the right-hand side also approaches the limit i, and 
cLgain we have : 
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The mathematicians of that age may not have been rigorous, 
but there was a joy of living which the world can never afford to 
ignore. Their antics still amuse us; they can instruct us. Turn 
again to the series 1) and be modem; compute the sum of the first 
n terms. It is alternately 1 and 0 : 

= \, So=0, ^ 3 = 1 , z= 0, • ‘ * 

Well, its average value is isn’t it? That’s something to go on. 
In fact, it is a great deal, for it gave Frobenius as far back as 1880 
(Crelle 89) an idea which can be formulated as follows. 

Summahle Series, Let 

2) + ^2 "h * ' ' 

be a series, and let 

3) 4- + * • • + an. 

Take the average of the first n SnS : 


4) 5 = ^2 -h * • * + 

n 

If Sn approaches a limit as n becomes infinite : 

lim Sn = c, 

n—oo 

then the series 2) is said to be summahle, and the number c is 
attached to it as its value (sometimes called its sum). 

If the series 2) is convergent, then c will be its value in the 
ordinary sense, or lim Sn — c. 

Apply this definition to the series 1) : 

Sn = when n — 2m 


2m- 1 


when 


n — 2m — 1 


Hence 


lim Sn = 

n~x 


and so ^ is the v^alue assigned by this definition to the series 1). 

But there was a second argument of Friend Euler, why the 
series 1) must have the value L Let us see what that view can do 
for us. Form the power series 
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5) aix -f • • • 

And now I say : If the series 2) vi summahle, the series 5) will 
converge when \ x \ <. 1 : 

6) / {x) = aQ + a^x + a^x^ -f • • • . 

The function f (x) will approach a limit as x approaches 1, and 
the value of this limit will be tlue value^ c, of the sumrnable series 
2 ):' 

lim f{x) — c. 

From the delinition of Sn it is easy to infer that 
•^1 — 

So = 3 A‘3 — 2 A'o, 

and, generally: 

7) Sn — n Sjt {n 1 ) 

From this formula we read off at once the following 

Li MM A. If 

\S„\< G, n=l,2, ■■■, ■ 

then 

8) \sn \ < 2n(r. 

Let 

(.r) = <aro + ^ + * • • + 

s„{.,)= ■^■U)+ ••• + fr(^). 

n 

We proceed to transform by a process similar to that used 

in the proof of AbeFs dheore.n. Chap. V, .^6. From 3) we have: 

Uq = = 50 ““ ' t 1 ^ Sn 1* 


i„{x) = + (-^2 — -51)^; + • • • + (^n — Sn-l) ^ 


= ^ Sv (x'' * — X‘) + ^nX" ' 
v=l 


= (i — ‘ + '• 

V=1 


1 lence 
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The infinite series 


\x \ < 1 , 

V =1 

converges because of 7); and likewise the term approaches a 

limit, namely, 0. Hence the series 5) converges when 1 x | < 1 , and 


9) 


V =1 


Neiv Proof of AbeVs Theorem, From this last equation we 
readily infer Abel’s Theorem. For, if lim Sv = c, then 


Hence 


and so 


or 


C— €<Sv<C + €. 


yn-1 


. m — 1 


~ 1 _ j. ' = X ^ -fz: 

v=:m 

(c— €)x'"~^ ^ (1 — x) ^ S,x'“^ ^ (c + €)x"*”^ 


(1 - x) svx'-i = (c + 1 t 1 S €. 

y=»m 

Thus from 9) 

/(x) = (1 — x) s, x''”* + (c + C) 

■,==1 

Hence 

/(x) - C = (1 - x) 5, x'’-! - C (1 - x"-!) + C 

V =1 

In this equation rests the .proof. For 

I 

where m is already fixed, and \x\ < 1. And now each of the 
first two terms on the right can be made numerically less than € in 
absolute value by restricting x to a suitable interval, 

1 - J < X < 1. 

Hence 

|/(x) - C 1 <3€, 0<1-X<(f, 



q. e. d. 


Thus 
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We return now to the proof of the main theorem. From 7) 
it follows that 

Sv fi» 5, — (v — 1) 5v_i] 

v=i i;=l 

= ^ x'') + mSmX"'~^ 

v=l 

m -1 

= (1 — ar)^ »'5vx’'~i+ mSm3f'~\ 

Vcsl 

Since 2) is summable, 

I5„| < G, 

and so the last term on the right approaches 0 when m = oo 
( |a:l < 1). For the same reason, the series 

V =1 

converges. Hence finally 

10) /(:r)=(l-x)’-f;vSva7''-i. 

V=»l 

The last step : 

lim f{x) = c, 


can now be taken exactly as in the proof of Abel’s Theorem just 
given. Since Sn approaches c, 

c— c<5v<c + €, m S V. 

Hence 


{c 


c) ^ ^ ^ vSy,X^^ ^ vx'^\ 

v==m v=m v=m 


or 

11) 

Observe that 


= (c + C)X^ 

v*=sm 


1 

h-xf 


vS 


ItlSc. 
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and write as a nutter of notation: 

m— 1 m-i 

A='^vS,x^-\ 


^.v-1 


V=1 


V=i 


Thus 


^ v5va:''+^ 

= V 1/ — // — 





\t=m 

v=l 


\s=m 

II 

1 

H 

II 

1 

— R 

(1 -X)2 

L> • 


Equation 11), multiplied by (1 — x)', now gives, because of 10): 


fix) - (1 - .4 = (c + t) [1 - (1 - Bl 

Hence 

fix) — c = 4 + (1 — x)^^ — (<? + C) (1 — B. 

Since A and B are polynomials, they are bounded in the interval 
0 ^ a: < t : 

\A \ < M, \B \ < M, 0 £ X < \. 
Consequently 

I (1 - x)2^- (c + 0(1 -xfB\ ^ (1 + Id -h €)M(1 - x)\ 
This last quantity is small for values of x near unity, or 
(1 + 1 c 1 + €) M(1 — 3:)- < €, 1 — < 1. 

Hence 

1 fix) - c I < 2c, \ ^ < X < \, 

and this completes the proof. 

§12. Summable Fourier^s Series. Let f(x) be continuous 
for all values of x and let f(x) have the period 2:r. Form the 
Fourier’s coefficients and write down the Fourier’s series : 

— + V {an cos nx + bn sin nx). 

This series does not in general converge. It is, however, siunmable. 
to the value f (x), as we will now prove. Liet 
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Recalling the expression for the Fourier’s coefficients, §1,2), we 
bee that 

Sn {x) — — ^ /(O [ i + cos {t — x) + cos2 {t -- x) + • • • 

—71 

+ cos (ti — 1 ) (f — :c) ] dt. 

The series in the bracket can he summed by Formula 5), § 5, 
and thus Sn (x) takes the form : 


/ (£) 1) — j:) COS ^ x) 

” 2ir ^ 1 — cos (t — j:) 


dr 


It is now easy to compute the value of 


We find : 


U-) = (^) + • • • + ^n(x) 

n 


7t 

c \ \ r 1 — cos n (^ — a:) 

Sn\X) = / fit) dt, 

IvJ n [1 — cos — x) J 


Make the change of variable : 

t — a- 


a ~ 


2 


r = .r -f 2a. 


I'hen 

1 ) 


Sn (x) ~ - / /(a: -f 2a) d cl. 

TT ^ n sin- a 


Lemma. Let tp (a) be continuous in the interval 
0 a 2 » 

an I lei c (a) approach a limit when a approaches 0: 

lim ^(a) — c (0"^). 
a=0+ 


lim 

rvBsr^ 



u 


sin- wa 
n sin- a 


rfa = 1-^(0+). 


Then 
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Similarly^ 


0 

lim C tp (a) da. — — f (0”), 

ns=oo o n sin- OL 2 


if ip (a) 15 continuous in the interval 




a < 0, 


and if (a) approaches a limit when a approaches 0 ; 


lim ^ (a) = ^ (0 ), 
0 = 0 *“ 


Proof. Observe that 

2 

/ sm^na^^ _ ^ 
n sin^ a 2 


For, let 


(^) = i + cos X cos 2;r + • * * + cos [k — 1) x. 


Then 


and 


sm^/zot 


-r-^ = — [(Tj (2 a) + • • • + (r„ (2 a) ] 
n sin^ o. n 


V 

j* <Ti{2(i)da = 


L-t 


(a) = <£ (0+) + C- 

To an arbitTciry positive € corresponds a positive <5^ such that 

! 4 I < €, 0 < a < (y. 

On the other hand, C is bounded, and so 

i 4 1 ^ M, 0 < a g f . 


We can now write : 


J * / V sin^/id , /fv+N r sin^/za , 

*PW ^ <p{Sr) I - : da. 
nsinra ^ J nsin^a 



250 


I LNCriONS OF RF.AL VARIABLES 


r, p 

, r f, sin-^a , , /* . sin“/za , 

+ I C ■ . o da. + I 4— _Ja. 

,7 // sirr a // sm^ a 

U 0 

1 he first integral on the right has the value ir/2. The other 
two can be <i[)praise(l as follows. 

; . , I " o ^ 

/zsin-oc , ,7 /2sin-a J nsiri'^oc 2 

IJ O n 


! ?* 

J * . sin“7/a ; I ^ /* ' * I sin“A2a , ^ ir 

4 - ■ o ^ I ^ I I 4 I — - da.< — 

7zsin-a. j J nsm-oi 2n 


M 


sin^(y 


Now, € and S are fixed. Choose m so that 
T M 


2 m siir<y 


< €. 


Then 


< (f+0^’ 


m = 72, 


and the first part of the lennn.i is proved. — The second part follows 
from the first by a mere change of variable, p = — oc. 

Turning now to Equation 1) and applying the f/ernma, we see 
that, lor an arbitrary choice of x, the variable Sn ix) approaches a 
limit, and 

lim S'„U) =/(x). 

nt=zx 

I'his ]) roves the theorem. 

(rt'flcralizations. It is evident that the above proof applies to a 
much more general class of functions. In fact, let f{x) be any 
fun( tion which is continuous at a point x — x\ and is integrable 
and is such that the Fourier’s coefficients have a meaning, and that 
moreover the appraisals used in the proof of the Lemma apply. 
Then tlie Fourier’s series is summable at the point x^ to the 
Vtilue f (x^). 
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In particular, if f{x) has only isolated discontinuities, at each 
of which both the limits 

lim /(ar) =/(c+), lim /(a:) =/(c~) 

exist, and if 

/ (c) = i [/(c'*') + / (c") ], 

then 

lim 5„(c) =/(c). 

77=00 

Uniform Summability. Returning now to the case that f{x) 
is everywhere continuous, we see at once that f{x) is uniformly 
continuous for all values of x. To a positive € chosen at pleasure 
there corresponds, then, a positive S independent of x, x^ such that 

l/W -/U') I < f. lx-x'|<<*‘ 

On using this S the foregoing proof shows that the Fourier’s series 
is uniformly summahle to the value f{x). 

§ 13. Concluding Remarks. A Classical Convergence Proof, 
Dunham Jackson has given to a classical convergence proof a parti- 
cularly simple form. Let f{x) be continuous in the interval ( — r, ir) 
except at a finite number of points, and let fix) be absolutely 
integrable there; i. e. 

f \f{x)\dx 


converges. Lei f{x) have the period 2ir : 

f{x + 2ir) =f{x). 

At a point = £ let 

i) lim /(a;) =/(!+), 

x='+ 

and let the difference-quotient 

/({ + «)-/(;*) _ , 

h 

be bounded. 

Consider the Fourier’s series of this function. Let 




Set 

u = t — Xy r = M + 

Then 

7t 

2) 

Sn (x) = ,J*f {u + x) (Tniu) d ii. 

Break this integral 

up into 

3) 

0 7C 

/-/ 

and cousider 

— :t 0 

4) 

—J‘ /(« + x) <T^{u)du. 

0 

Observe that 



1 1 
-J <r„{u)du= 

Hence 

0 

71 

5) 1 

T 



0 


Thus 
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7C 

6) ~ J* f(u + i) (r„iu)du — 

0 

= 1 r /(^ + 4)-/(C ) « sin (n + i) udu. 

TT^J u 2 Sin t M 

• 0 

This last integral approaches 0 as ti becomes infinite; §2, 
Exercise 5. Hence the left-hand side of 6) approaches 0, and we have: 

7t 

7) lim — T/Cu + S) or„(u)£?M = -^ /(£+). 

7Z=30 T /it 

U 

It' we replace the condition i) by the requirement that 


i') lim /(x) —/($"); 

x=5- 


and if, instead of iil, we write: 


h 

demanding that this difference- quotient be bounded, it then follows 
at once that 


8 ) 


u 

lim— r /(m + x) or„(«)c?« = 

71=00 TT Z 


On combining these two results, assuming that both O>nditions 
i) and iO are fulfilled, and likewise ii) and ii'), we see that the 
Fourier’s expansion converges at 4 to the value 


+ /($-)]• 


If f{jx) is continuous at 4, the series converges to the value y (4). 
We have thus proved the following theorem. 

Theorem. Let f{x) he continuous in the interval ( — ir, ir) 
except at most for a finite number of points^ and let f{x) be 
absolutely integrable: 



converges. 


Then the Fourier's series converges toward the value of the func- 
tion in each point in which f{x) has a derivative. 
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More generally^ let the condition of differentiability he replaced 
by the requirement that the limits 

lim /(x) =/($+), lim /(x) =/(4“) 

T==+ -r-;- 

exist and the difference quotients 

h h 

he hounded. Then the Fourier's series converges toward the value: 

H/(4+) +/(£-) ]. 

Evaluation through Complex Variables. Consider the following 
development in the complex domain : 



T-'he circle of convergence is the unit circle. The series converges 
in every point of the circumference, except z •= d: 1, to the value 

r, f r. , COS 50 , CX)S 59 , \ 

2^cos0+-^ +__+ ...j 

+ 2i(sin0+i^ +^-.+ •••). 

Since the function is continuous there, the value ot' the fun( tion 
and the value of the series are the same, by Abel's Tlieorein, Cliap. 
V, § 6. Now, the angle of the argument of the function is 

r tp — — 2 . 0 <. 0 <. ir ; 

arc (1 F — arc (1 — z) = s 

C ^ o = — i. 


- T < 0 < 0; 
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and this is the coefficient of the pure imaginary ])art of the log- 
arithm : 

log (.V + Yi) - i log (X2 4- E") E i arc (X + Yil 


If^g [ ^ (cos © -f i sin @) ] — log R 4- © i. 


Hence 


sin 0 , sin 3^ , sin 50 , 

+ -"I— + ■ ' 


i ir, 0 <. 0 <. T \ 

0, e = 0; 

i Ty — IT < 0 < 0. 


Tn conclusion, an appreciation of the role which Fourier’s series 
have played in the developement of modern mathematics is found in 
the retiring address of Professor Edward Burr Van Vleck as Vice- 
President of Section A, A.A.A.S., published in Scienccy vol. 39, 1914. 


Exercises 


1. By means of the development: 

log ( 1 +z) = z — — + — — 


show that 


^ ^ sin 2 0 , sin 3 0 


2. From the series of Question 1 show that 
IT — 0 . « . sin20 . sin 30 . 


- r < 0 < 


0 < 0 < 2x. 


3. From 4) and 5) deduce 2). 

4. Let f (x) be continuous in the interval 

0 ^ X ^ Ty 

and let /’(O) = 0, y^(ir) = 0. Let f{x) have a continuous first 
derivative except at a finite number of points, at each of which it 
approaches a limit from above, and also a limit from below. Show 
that the series 

oo 2 n 

sin nXy b„ = — I f sin 72 .r dxj 

n-asl ^ Y 
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(leiines a function, = F(x^y), continuous in the region 

0 ^ y <. oo, 

and satisfying Laplace’s Equation : 


dx- 


= 0 , 


at all points (x, r) of ihe region, for whicli 0 *< y. Moreover, u 
takes on tlie houndarv values 


and 


i) F(0, j) = 0; 

ii) F{Tr,y) = 0 ; 

iii) F {x\ 0) — fix); 

iv) lim F {xy y) -- 0, 


no matter how x varies. 

5. Consider the region 

JR: oo. 

\^qX f {x) satisfy the saire conditions as in Question 4. Show that 
tile series 


«« 2 /» 

V hn sin nx, bn ^ — / f ix) sin nx dx^ 

defines a function ii ~ F (.r, which satifies the Heat Equation : 


d u 
d~t 



at all interior points of 71 and also in the boundary points 

.r = 0, 0 -< r < oo and x ^ tt, 0 ^ <1 oc). 

Moreover, u takes on the boundary values: 

i) F(0, Q = 0; 

ii) F(ir,r) = 0; 

iii) Fix,0)=f{x), 

and 

iv) liin F{x, t) = 0, 


no matter how x varies. 
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6. I^t it be required to solve the bleat Equation : 

du o d^Li 

a? 

in the region 

R: Q ^ t <. oo : 

« = $ (x, £). 

subject to the boundary conditions 

i) (F (0,0=0; 

ii) 0 = 

iii) $ (t, 0) =<p(x); 

iv) ^ (x, oo) = 0, 

where (p{x) is continuous and ^(0) = 0, ^(ir) = c; moreover, (p{x) 
shall have a continuous derivative except at a finite number of 
points, at each of which the derivative shall approach a limit from 
above, and also a limit from below. 

Show that this problem is referred to that of Question 5 by 
setting 

/ (^) = ^ w - —X, 

TT 

$ (x, t) = F{x, t) + —X. 



Chapter IX 

Definite Integrals. Line Integrals 


§ 1. Proper Integrals. Continuity. Consider tlie integral 



r, a) dx. 


If we impose on the function J (x, a) tiierely enough conditions to 
insure the (onvergence of the integral, the function c (a) represented 
by the integral : 

A 

<P («■) = J fix, «•) dx, 

a 


will have no properties; i.e. it may be any function whatever. For, 
choose arbitrarily, and set 

fix,a.)= 

b — a 

Then 

h 

9{<x)- J‘ 


We will begin by restricting the integrand as follows. 

Theorkm. Let the fwict ion f {x, a) be continuous in the closed 
region : 

R: a^x^b, B. 

Then the function (f {a) defined by the integral: 


1 ) 



ot) dx. 


will be continuous in the closed interval 

A ^ B. 
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Geometrically, the truth of the theorem is at once obvious. 
For, represent the integrand ^ 

by a surface : 

2) z=f{x,a). 

Cut the surface by the plane 
a = tto, where ao is any 
point of the interval B). 

Then the value of the in- 
tegral, or is given 

by the area under the curve 
of intersection of the plane 
with the surface. 

Next, cut the surface by the plane a = ao -f Aa. The value 
of the integral, or <p (ao -f Aa), is now represented by the area of a 
near-by curve, and so does not differ much from the former area. 
Hence <p(cL) is continuous. 

The arithmetic proof is as follows. Since a) is continuous 
in the closed region R, it is uniformly continuous there. To an 
arbitrary positive €, then, there corresponds a positive S, independent 
of (x, a), (.r', a') and such that 



|/(x, a) — /(x', a') I < €, 


j 1 X - x' 1 < (T 

I 1 a — a' I < S 


provided (.r, a), (x^ a^) are in R, Now form the difference : 


h 



a 


X, ao + Aa) — / (x, ao) 1 Ax. 


Let Aa be restricted to the interval I Aa 1 < ^. Then 


l/(x,ao -f Aa) -/(x, ao) 1 < €, 


and so 


V 

I (cto -f A a) — ^ (ao) i < J" c c^x = — a) €, | A a | < 

a 

This completes the proof. 
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Exercises 


1. Criticise the I'ollowing proof. “In the equation : 

h 

+ Act) — If (cto) = J' \f{x, a-o + A<x) — /(x, «o) ! 

a 

let A a approach 0. Since 


lim lf(x, tto + Aft) — fix, ao) i = 0 
Aa=0 

the right-hand side approaches 0. Hence the left-liand side approaches 
0, and the function ip (a) is continuous.” 

2. Prove that 

X 

^ f a) dx 

is a continuous function of (a, x, $), where f{x. a.) satisfies the con' 
ditions of the theorem, and a S x ^ b, a ^ ^ ^ h, 

3. By means of the ecpiation 

I x^"^ dx =1= ^ ? , 0 < X, 

J CL 

1 

prove that 

lim ^ J = log^, 0 < £. 

(x,a)=f?,0. CL 

4. Let f (x, a) be a function which, for each cl of an infinite 
point set r/, is continuous in the closed interval 

a ^ x h. 

Let ccq be a point of condensation of Ay but not necessarily a point 
of Let y (jr, a) approach a limit when {x, cl) approaches {xq, ccq), 
where Xq is any point of the interval (a, b). Then the function 

h 

•pW = J f (x, a) dx 

a 

approaches a limit when a approaches ao- 
Moreover, the function 

lim /(xy a) = CO (x) 
a=ao 

is continuous in the interval a ^ x ^ by and 
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Succinctly, then. 


lirn ip (a) 
a==ao 


h 



a 


dx. 


liin 
a— oo 



a 



§ 2. Continuation. Several Parameters. The integrand may 
depend on several parameters : f {x., , ot«n). Let (ccj, • • •, a/,) 

be any point of a closed region B (Chap. Ill, § 1 ) of the n-dimensional 
space of the a’s ; and let x lie in the closed interval 

a X ^ b. 

Let y(.r, aj, • • *,»„) be continuous in the closed region thus defined 
in the (V 2 -f 1 )- dimensional space of the (x, a„). Then 


h 



a 


is continuous in B. — The proof is essentially the same as in the 
earlier case. 

Multiple Integrals. I^t r be a region of the [x, r) -space, 
and let f{x,y, z, a„) be continuous in the region R of the 

(3 + n)-dimensional space defined by r and B. 'Fhen the triple 
integral of f., extended over r, defines a continuous function of the a’s: 


2 ) 


J* J* a. 1 , ■ • ■ , a.„) dr. 


where ^ (a^, • • san) is continuous in R. • 

Of course, a similar remark applies to double and surface integrals 
on the one hand : 


3) <p{a-i, • • -,(^ 71 ) = J‘ J' f{x,y,<f.i,- -,v.n)d(r 

a 

and to m-fold volume or (hyper-) surface integrals on the other : 


J" (-^it * * * » * * * I dr ; 

the function ^(a^, • • •,a 7 ,) being in each case continuous in R, and 
f continuous in R. 


4) SP(tXi, • • •,a„) = 


-IJ 
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For example, consider the integrals that define a Newtonian 
potential function : 


5) 




(T dS 
r 


r and 5* here denoting the region r or or, and p, or meaning the 
volume or the surface density. Thus 

r- = (x — af T (y — b)- 4* (r — c)^ 

p • - p {x, 7 , z), (T - (T (.r, j), 


or, in the case of a curved surface 5, cr is a continuous function 
on 5. 

The Iterated Integral. It is precisely these theorems that are 
needed to complete the proof of evaluation of the multiple integral 
by means of the iterated integral*. Thus in establisiiing the evalua- 

,, r, 

6) J J dxj f{x,y)dy, 

a Yi 

it is essential to know that the first integral. 


Y2 

7 ) J fix,y)dy, 

ri 

is a continuous function of x, and this brings us to the last of the 
generalizations, namely : 


Tufokkm 2. Ixt f (x, a) be continuous in the closed region 

R : a X ^ b^ A ^ (K ^ B, 

where 

a = \fr(a), — co (a), ^ M < co (a). 

and \jr (a), co (a) are any functions continuous in the interval 
A ^ a ^ B. Then the integral from a to b, of the function f, 
is a continuous function of a; 

h 

8) f(«-)= I fix, n) (lx. 


* cf. The Author’s jidvaiiced Calculus, p. 260, and the Funhtionenthcarie, 
Tol. I, 1928, p. 118. 
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Here, again, the intuitional proof by geometry — the area under 
the surface, § 1 — is suggestive and convircing — as convincing as 
intuitional geometry can he. 



The analytic proof is simple. Make a change of variable : 

X a 


t — 


h — a 


Then 

9) 


h 1 

//< .r, a) dx ^ ^ {b a) J [{b -- a) t + a, ot] dt. 


The latter integral represents a continuous function by Theorem 1, § 1. 

The extension to the case of n parameters, (ctj, • * • , an), considered 
in a region 5, is immediate, the proof requiring no modification: 


10 ) 

a =vj/-(ai, 


o 

<f («ii • • •, «n) = J* a„) dx, 

a 

,an)i b 0} (diy • • • ,CCn)i ^ ^ ® (c**!? ' ‘ * »0tn). 


§3. Differentiation. Leibnizes Rule. 

entiation of the function 


1 ) 


If 

y(*) = J" f{x,a)dx. 


Consider the differ- 


Form the difference- quotient ; 

, tf («o + Act) — c (ao) r fix, 0.(1 + Aa) — f(x, an) , 
A^^ -J A^^ 

a 

If the partial derivative of f{xycC) with respect to a exists: 


lijn gp -f Act) - f{xy(KQ ) _ ^ 
^ - 0 Aa d a 
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the integrand approaches a limit when A a approaches 0, and it wai 
formerly considered self-evident that 


■ 2 ) 


dip 

doi 


I J da. 


dx^ 


or that the definite integral can be differentiated under the sign of 
integration. The formula 2) is known as Leibnizes Rule. 

Here is, of course, a double-limit fallacy. What we want is : 


Um 4^, 
Aa=0 


li,„ //Uao + A<x)-/Uao) 
At<=--oJ 


and what we have found is: 


r ii„, ^<t o + Aa)-/(x.ao) 
J Aa=0 



Nevertheless, under suitable restrictions, both limits exist and the 
two are equal. 


Throrem. Let f{x,oi) be a continuous function of x in the 
closed interval a ^ x ^ b, a. having any fixed value in the in- 
terval A ^ OJ ^ B. Let Bf/da. exist at each point of the region 


R i a ^ X ^ b, A ^ a ^ B, 

a fid let the function 

4^ =/«Ua) 

be continuous in R. Let 

h 

v(«-) = ff{x,a)dx. 

a 

Then has a derivative , given by. Leibnizes Ride: 


dip 

da 




and ^'(o.) is continuous., A ^ a ^ B, 
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1 . 


By the Law of the Mean 

f [x, (Xq + Aa) — / {x, (Xq) ~ Ao. fa (*r, olq + OAca), 0 < 9 

The function f(t{x,a^) is uniformly continuous in R. Hence to an 
arbitrary € > 0 corresponds a > 0, independent of {x, a), {.j/, a^), 
such that 

\x — \ < S 

. < <5^ 

It follows, then, that 

h 


!/o,U,a) -/,(x',a') < €, 


r I X - x' i 
1 I a — a' 1 

f (ao + Ao-) - tf (a.„) ^ x, 

^ = I /aC^.^o + 0Aa.)dx. 

a 

<p (ao + Aa) - tf (ao) /* ^ , , , ^ 

J f„(x,aQ)dx ^ 


Aa 


* 7^ 

^ 1 /« {x, aQ + 9 Aa) —/a (.r, ao) \dx < J e dx {b — a) €, 

a 

provided \ Aa | < <?. This proves the theorem. 

The extension to the case of several parameters and multiple 
integrals is immediate. Let r be a closed region of the (xj, • • '.Xm)- 
space; B, a region of the (aj, • • •,a„)-space, and let ^(^i, • * ^m- 
<*• 1 , ■* * * , a/,) be defined in every point of the region R of the 
(:ri, ••*, a^, •••, a^)- space determined by r and B. For an 

arbitrary point (a) in il let f be continuous in r. Then the integral 
of y*, extended throughout r, defines a function ip of the (a): 


<P («-!, • • 

■ > <^n) — 

Let 

S.f 


da.^ 


l:J 


f * * * » * ’ * » ^n) dv* 


exist and be continuous in the interior points of the (m + n) -dimensional 
region il, and bounded. Then ip admits a partial derivative dtp/dou^^ 
given by Leibniz’s Rule: 

d ip 

t 
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and the function 


da.1 




is continuous in B. 

Example, Consider the potential : 

-Iff '4^- 

X 

^ 2. Hence, 


Further, since \/r is a solution of Laplace’s equation, 

A/> = = 0, 

o x“ dy- d z- 

il follows that u is, ^Iso. For 


EXERCtSE 


Differentiate the inte^fral : 


I 

/ 


d X 


1 -F j: -f a- 


by Jxibniz’s Rule, and verify the result by direct computation. 


§4, Variable Limits of Integration. Theorem. Let 

f {x, oi) be defined in the region 

R : a X ^ b, A ^ CL ^ B, 

a = v]/'(<x), b = CO (a), ^ ((l) <C. co((x), 

where \j/ (a), co (a) have continuous derivatives in the iutertal 
A ^ CL = B. Let f{x,(L) be continuous in x for each value of 
(L: a X ^ b. Finally, let 

dcL 
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exist at every point oj R not on the boundary a = \p^ (a), b = <0 (cc), 
and let f(x{x, a) be continuous on the boundary. Then the function 

h 

e {(x) = ^ f (x, a) dx 

a 

admits a de?'ii^ative, continuous in the interval A ^ cl ^ B, and 
given by the- formula : 




da 

dcL 


The proof is simple in case the definition of the function can 
be extended to a somewhat larger region, 

R': a ^ X ^ b, A ^ CL By 

a = xjri (a) < \j/^ (cl), 3 = 05] (a.) > oj (a). 

For then we have: 

(f (*0 + A») — <p (^o) =f i/(^. <^0 + Act) - /{.r, cto) } dx 
"o 

bQ+^b ao 

x, ao -f Aoc) c/j: + ^ f (x^cLq Acl) dx. 
z?o ^0+*^® 

The first integral can be treated as in § 3. The second can be 
appraised by the Law of the Mean for integrals : 

ho+^b 

J* f(x, ao + Aa) dx Ab f(X, ao 4- Aa), 

where X lies between b^ and -r Ab. And the last integral can 
be represented in a similar manner. Thus 


‘0 

—f fa (r, oto + ® Aa) + 


^^-/(X,ao + Aa) - -^/(X',ao + Aa), 


Aa ' 
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lim X = lim 

Aa=0 Aa=0 


and the completion of the proof is now easy. 

When such an extension of the definition is not obvious or 
possible, the above proof can be modified without great difficulty, but 
there is a simpler treatment, which we will not undertake to repro- 
duce here; cf. the Author’s Funktionentheorie, vol. I, 1928, p. 122. 
On the other hand, if one adds to the restrictions on the 

requirement of the existence and continuity of df/dx^ the transfor- 
mation of the variable of integration used in § 2, whereby 


/• 1 

/^< X, a) dx = — (^ — a) t + a, a ] r. 


leads at once to a proof. 


§5. Iterated Integral with Constant Limits. Theorem. 
Let f (x, y) be continuous in the rectangle 


R: 

Then 


< X ^ b. 


AS y^B. 


jdx J* f{x,y)dy= 
a A A a 

It is possible to give a simple proof of this theorem without 
recourse to the double integral. Form the function 


The function 


= / dx s f{x,y)dy. 

a A 

r 

J f(x,y)dy 


is continuous in R, cf. § 1, Exerdse 2, and it has a continuous 
derivative with respect to y. Hence by § 5 
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Thus 


and 


B 

I f (-r, j) dy — Fx {x, B) — Fx [x. A) 

A 

h S 

f f{x^y)dy = 

a A 

F{b, B) - F{a, B) - F{b, A) + F{a, A), 


Because of the syniinetry in the result it is obvious that the 
itemted integral taken in the reverse order has the same value, and 
this completes the proof. 


d“ u ii 

§ 6. Proof that 5 r^r ” d^d~x * u — F {x, y) be continu- 
ous in the neighborhood of a point (xq, yo)- the first partial 

derivatives exist and be continuous in this region, and also the second 
partial derivatives in question. Choose a rectangle R, § 5, containing 
the point (jtq, yo) interior and itself lying wholly within the 

above neighborhood. I^et 


1) 


^ (^5 r ) = 


d^u 


dxdy 


and compute the' integral : 


2) 


/-/ 


{x, y) dx 


5 n 
Its value by § 5 is : 


u 

d yd X 


a ^ i <, X ^ b 
A ^ <. y B 




^ •'i ' ^ 

Each of these integrals has the value : 


dx. 


Fix, y) — Fii,y) — F [x, I)) + F (S, tj). 

Consequently the integral 2) has the value 0, and hence the function 
^{x^y) vanishes identically. For, if ^{x,y) were positive (negative) 
at a point within R, the limits of integration in 2) could be so 
chosen that the integral 2) would be positive (negative). It follows, 
then, that 
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§7. Improper Integrals.* Consider the improper integral 

oo 

1) J*f(,x,<i)dx. 

C 

The integrand shall be continuous in the region 


R: 


C ^ X <. oo, 




and the integral shall converge for all values of a in the interval 
{A,B). Thus the integral defines a function of a: 


2 ) 


00 

<(>(«■)= J* fix, cc) dx. 


The function <p{(t) is not, however, in general continuous. For 
example, the integral 


3) 


OQ 

/* 


2 a^jf 


dx 


converges for all values of a. Its value, ^(a), is 1 when a 7^ 0; 
but when <x ~ 0, it vanishes: 


a ^ 0; 


= 1, 

Its graph, .y = f («.), 
is a line parallel to 
the axis of a and 1 
unit above it, except 
when (X = 0; then it 
drops to the origin. 

Again, consider the integral 
4) v)/'(a)= J* a 


c ( 0 ) = 0 . 




— A 

1 

« X 

0] 



3 


dx. 


This integral converges for all values of ct, and 

(ot) = OL. 


• The following treatment presupposes the ordinary tests for convergence 
as developed in the Calculus; cf. for example, the Author^s Advanced Calculus, 
Cap. XDC. 



DEFINITE INTEGRALS. LINE INTEGRALS 


271 


Moreover, df/da exists and is continuous for all points 0 = < oo, 

— oo < a < oo: 

— = (3a- — 2ai*x) 

ocu 

Nevertheless, differentiation under the sign of integration is impossible 
when a = 0. For 

dOL 


but the integral 


0 

when a = 0. 

And still again, it is not true that 

<*1 oo 00 *1 

/ p (x, a) dx = dx x, ol) doL, 

Oq c C Oq 

even when a) satisfies the above requirements and all the in- 
tegrals involved converge. For example, let 

f (x, a) = (2a — 2(x?x) 

It is readily shown by direct computation that 


oo 

X, a) dx = 0 


for all values of a. Hence 


a oo 

X, a) dx = 0. 


0 0 

On the other hand. 


(X 

^ /(x,a)flla = Oi 




Thus 


oo a oo 

J dx J f{x,cL)doi= are^’^^dx. 


This is the integral 3), and its value is 1 when a ^ 0. 
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§ 8. Double Limits. The phenomena described in the last 
paragraph are all examples of double limits \ 


lim 



and 



lim and 

A a 


00 

J Um/(x, a.)dx-, 
o^t) 


oo 

/ 


lim dx\ 
A (»«0 


lim YAajc f f{x,aj,)‘dx and f lim V /(a:, a*) 

n-=ooj^_l ^ ^ 

c c 

The questions are precisely similar to those that arose in infinite 
series : 

i) Continuity of the function defined by a convergent series 
of continuous functions; 

ii) Differentiation of a series term-by-term; 

iii) Integration of a series term-by-term. 

In the earlier case we found that uniform convergence was the 
key to the situation, for it enabled us each time to infer the equality 
of the two double limits. The same holds true here. We lay down 
a definition of uniform convergence for an integral analogous to the 
definition of uniform convergence for a series, and apply it in a 
similar manner. 

In a larger sense both definitions of uniform convergence come 
under the general case embodied in the theorem of Chap. V, § 10. 

§9. Uniform Convergence* Definition. Let f{x,oi) be a 
function which, for each point a of an infinite point set yt/, is con- 
tinuous in JT, 

c = < oo. 

The integral 

oo 

1) f f{x,a.)dx 

C 

is said to converge uniformly in the point set A if, to a positive € 
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chosen at pleasure there, corresponds a number g c) independent 
of oi and such that 


xn 

J f{x,(t.)dx 

Xt 


< 


x', x". 


Theorem I. A necessary and sufficient condition for the 
uniform convergence of the integral 1) is that, to a positive c 
chosen at pleasure, there correspond a number g c, independent of 
(K and such that 


P 


{x, a) dx 


< 




' e I 

Theorem IT. A necessary and sufficient^ condition for the uni- 
form convergence of the integral 1) is that, to a positive € chosen 
at pleasure, there correspond a number g c) independent of a 
and such that 



X, cl) dx 


X 


< 


g = X < CO. 


§10, The de la Vall^e-Poussin fL (x) - Test, Weierstrass’s 
M-Test for uniform convergence in the case of infinite series finds 
its exact counterpart in de la ValF?e- Poussin’s p.(x)-']'est in the case 
of definite integrals, 

De la. Va.llee-Pol:ssin’s p. (x)-TEsr. Let ^ (x) be a function 
continuous for c ^ y ^ x. If 


i) 

ii) 


|/(jr,a) I ^ J*. {x\ X, A ^ B\ 

oo 

f lt.{x)dx 


converges, then the integral 


j /(sr, a) 

C 

converges uniformly in the interval 


dx 

A ^ a ^ B. 


• For the sufficient condition one must, of course, begin by requiring the 
plain convergence of the integral 1) 
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Proof, Let € > 0 be chosen arbitrarily. Then y) car 

be so determined that 

J fJL {x)dx < €, g ^ x' < x". 


Now, 


Hence 


x'f xf* xff 

J fix, a.) dx <j \fix,a.)\dx^ J fi (x) d X. 


X" 

j /(^.a) 


dx 


< €, x' < x". 


Blit g is independent of a, and so the theorem is proved. 
Example. The integral 


QQ 

/*■■■ 


dx 


converges uniformly in any interval bounded, from above: 

a. S G, 

For, let 

liix) = x^-'e~^. 

Exerctsks 

1. Show that the integral 


oo 


e ^ log xdx 


converges uniformly in every interval bounded from above. 

2. The same for 


or* ^ {logx)^ dx. 


3. What can you say regarding the uniform convergence of' 
the integral 


/ 


e ^cos CLxdx ? 
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4. The same for 


5. The same for 








§ 11. Continuity. Theorem. If f {x,ol) is continuous in 
the region 

R : c ^ X < oo, A ^ a ^ B, 


and if the integral 


oo 


converges uniformly' in the interval A ^ cn ^ B, then the in- 
tegral defines a function^ 


CO 

(a) = a) dx\ 


continuous in that interval. 

Proof. We wish to show that, to an arbitrary A ^ cLq ^ B 
and to a positive € chosen at pleasure, there corresponds a positive S 
such that 

I <f (wo + A) — f (oto) I < «, I A I < ^, A ^ + h ^ B. 


>{af, + h) — f (tto) = f \f{x, cto + fe) - /(.r, ttp) 'j dx + 


OO oo 

J /(f, Wfl + h)dx—f f{x,a.o)dx, 

e e 

no matter how c ^ ^ be chosen. Let c' be an arbitrary positive 
number. Then, by Theorem II, § 9, a number g c and inde* 
pendent of oLq, h can be found such that 
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CO QO 

^ J* f {x. clq + h) dx < €', f{x,aa)dx 




Hold this g fast. Then, since 


g 

J fix, aydi 


represents a continuous function of a in the interval = a. ^ 5 by 
§ 1, it follows that 

\fix,a.Q + h)—fix,a.Q)\dx < €', jAl < <y. 


Hence 


I ^(tto + A) — y(ao) I < 3 I A I < (J, 


and it remains only to choose so that 3 c' = c. 

Example. The integral 

oo 

1 

1 -epresents a continuous function for all values of a. For, let ao be 
an arbitrary value. Let G be chosen > ao- Then the integral 
converges uniformly in the interval a ^ G (cf. § 10) and so repre- 
sents a function continuous at a = olq. 


Exercises 

1. Let a point set ^ = [a} be given, witn a point of con- 
densation, ao- Let f {x, a) be a continuous function of x in the 
interval 

c ^ X < oo 

for each a, c being a constant. 

i) Let f (.r, a) converge uniformly in any finite interval, 

X ^ Gy 

when Os approaches aQ ; 


ii) Let 


J* fix,a)dx 
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<x 5 nverge uniformly in J. Then : — 


lim f {x, 0 .) = CO (x) 


is continuous, c = < 00 ; 


CD (:c) d X converges ; 


00 CO 

c) lim I f {x, a.) dx = / Y\n\ f {x, (t) dx. 

a=ao •J 

c c 

2 . Let f [x, a) be a function which, for each 00 of an infinit 
point set A, is continuous in x, 

c ^ X < 00. 

I.et clq be a point of condensation of For an arbitraiy value x 
of X let f (.r, cc) approach a limit : 

lim fix, a) exists, c ^ x^ < co. 

(X, a) = fr», Oq; 

Finally, let the integral 




converge uniformly in A. Then : — 


lim fix, (x) = CD ix) 

a=ao 


is continuous, c ^ x <. 00 • 




)dx converges; 


c) lirn I fix,cL)dx= j lim fix, cl) dx. 

ty a==oto 


§12. Integration. Reversal of the Order. TuEor^EM. I 

the function fix,aY) is continuous in. the region 

R : c ^ X C. 00^ A ^ a ^ B, 
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and if the integral 1), § 9, converges uniformly in the interval 
A S (t ^ B : 


then 


c (a) X, a) dx, 

c 

«! (y? ttj 

X, cl) da, 

tto c 

®1 OO 00^1 

J f f{x,(K)dx =f dx X, a) da. 


«o 




Proof. The function <p{a) is continuous by § 11. We wish to 
show that, to an arbitrary € > 0 there corresponds a number g 
c) such that 

X “1 


I ^ ip (a) da — ^ dx X, a) da 

Oo C Oo 


< «. g X. 


Now, 


oo oc 

X, a) dx — X, a) dx + //< X, a) dx, 

C c X 

and for a fixed x each integral on the right is a continuous function 
of a. Hence 

®1 oo *1 j; oo 

Jda.Jf{ X, a) dx J f{x,a.)dx + f da //< X, a) dx. 

<*0 C c Oq j: 

Ihe order of integration in the first integral on the right can 
be reversed, § 5. Thus 

®1 oo a? ®l ®1 oo 

/ f f{x,a.)dx — J dx X, a) da — //< x,a)dx. 


“0 


«0 


Bcjcause of the uniform convergence of the given integrad, 
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Hence 


oo 

1/ X, a) dx 


< I aj - 0-0 I g = X, 


and it remains merely to choose c' so that | ctj — | e' ^ c. 


Exercise 


Under the conditions of the theorem, show that the integral: 


oo a 


c A 

converges uniformly in the interval 


(x, a) rfa 


§13. Leibniz’s Rule. Theorem. Let the integral 1), §9, 
converge in the interval A ^ a ^ B : 

oo 

<«’(«•)= J f (x, a) dx, 

C 

Let df/dd exist and let the function 

= /« u. «•) 

Od 

be continuous in the region 

R: c = x < oo, A S d ^ B, 


Finally, let the integral 



dx 


converge uniformly in the interval A ^ d S B* 

Then the function (f{d) has a derivative, the derivative is 
continuous, and it is given by the last integral: 
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Proof, Let 


oo 

t («■) =f fa {x, «•) dx. 

C 

« oo a 

J'Vi<^)dx=JdxJ^da, 

A c A 

oo 

~J 

c 

oo CO 

= f fix, a) dx — //< X, A) dx. 


a 

^ vj/- (a) doi (p {(u) (p {A)^ 


and the proof is now given by the theorem of Chap. IV, § 7. 
Example, The function defined by 


oo 


can be differentiated with respect to a for all values of the argument. 


1 . Knowing that 


Exercises 


e ^ dx — — 


show that 


/ — 

^ r= ~ ^ ^ , 0 <C a. 


Hence show that 


• l/ir 

xP‘e'~^^dx = — l / — 1 ’ 0 < a. 

4 r (t^ 



DEFINITE INTEGRALS. LINE INTEGRALS 


281 


2. Obtain a formula for 


oo 

J* 3^e-^dx, 


n = 1, 2, 3, • 


§14. Applications. It is now possible to complete the proof 
of certain evaluations of definite integrals studied in the Calculus*. 
Example 1. Consider the integral 

OQ 

1) li = cos CLx dx, 

0 

The convergence for all values of (t was shown in the Calculus. 
Moreover 

da 

is continuous in the region 
R: O^x, 

and the integral 


xe * sm ax 


— oo < a < oo, 


s- 


xe'^^ smax dx 


converges uniformly for all values of a. Hence Leibniz’s Rule is 
justified. Integration by parts requires only elementary methods. 
Thus it is seen that 

du _ ^ 

^/a ■" 2 

The integral of this equation is the function (Chap. XII, § 7): 
u = ke * . 

When a = 0, 


oo 

"=/ 


e^^dx 


Hence the integral 1) has the value: 


_ V 


cosax dx ^ — e * . 


• CC. the Author’s Advanced Calculus, p. 487. 
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Example 2. The integral 

2) ^ 


dx 


can be treated in a similar manner. First, 


du 

dOL 


CO 

ax '^dx, a ^ 0, 


For, this last integral converges uniformly in the interval 

0 < <F g a. 


since 


and hence 


ax -e x 2 =~ie - < 

a a or 


ax'^'^e 4f2 = (x). 

d 

On changing the variable of integration, setting y ^ a/ x^ it is 
found that 

da ^ 
da 


Hence 


u = 0 < a, 


Let a approach 0. The integral 2) is uniformly convergent for 
all values of a. Hence 


and so 


liin u = 
0 = 0 + 



dx = 


/7 


2 


C = 


t/7 


2 ‘ 


If a < 0, the value of u is the same as for \ a \, 


u 



a, unrestricted. 


Hence finally 


The function is continuous at the origin (as elsewhere), but it 
has no derivative at the origin. It has a forward derivative, equal 
to — ]/ T ; and a backward derivative, + -j/ r . The function is 
an even function, and so its graph is symmetric in the axis of 
ordinates. 
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Exercise 


Evaluate the integral: 


Compute its value for a = 1. 

§15. The Gamma Function. Let the Gamma Function be 
defined by the integral, 


r (a) ~ ^ ^ e ^ dx. 


This integral is shown by the ordinary tests to converge for all positive 
values of cc : 0 < a; cf. Advanced Calcidus^ p. 480. We now 
proceed to show that F (a) is continuous for all such values of ot. 

Let the integral be written as : 


OO 1 oo 

s-s*s 


The second integral, 


oo 

x|r(a) = ^ 


dx. 


has already been shown to converge uniformly in any interval bounded 
from above. If, then, a' be an arbitrary value of a, it can be in- 
cluded within such an interval, and hence yjr (oc) is continuous at 
cl'. But oi' is any value of a. Hence the integral is continuous for 
all values of a. 

Turning now to the first integral. 


1 

f (a) =J* 




we see that this is an improper integral which can be transformed 
into the class considered in §§9-13 by a change of variable, 


X ’ t 


oo 

(a) = ^ e~T dt. 
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This integiul converges uniformly in any interval 0 <. S ^ a <, oo. 
Hence it represents a function continuous for all positive values of a, 
G>mbining the two results we see that F (a) is continuous for 
all positive values of a. 

Differentiation of the Gamma Function. The function 
has a derivative given by Leibniz’s Rule : 

oo 

^ e'^^logx dx. 

1 

The integral 4) can be differentiated under the sign of integra- 
tion for positive values of oc. Hence, on transforming back, we see 
that the same is true of the integral 5). 

Thus it appears that the Gamma Function has a continuous 
derivative for all positive values of a., given by the formula: 

oo 

6) ^ log X dx, 

0 

The existence of higher derivatives of all orders is proved in 
like manner: 

oo 

6) x^'“^ e"^^ {log x)^ dx. 

0 

§16. Improper Integrals over a Finite Interval. Instead 
of transforming the integral 5) into the form 4) considered in 
§§ 9-13 it is possible to give an independent treatment, parallel to 
that of the earlier case. 

Let f{x, ct) be continuous in the region 

R: a < X ^ h, A ^ ch ^ B, 

though not in general bounded. The integral 

h 

f f{x,CL)dx 

a 

is said to converge uniformly in the interval A ^ a ^ B if, to 
an arbitrary € > 0 theie corresponds a posilive tf, independent of a, 
such that 
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Xr 


< 


^ a/' < <2 4“ <^. 


The two theorems corresponding to Theorems I, 11, §9 are now 
formulated as before. The p. (ar)-test is developed, and the theorems 
of continuity (§ 11), reversal of the order of integration (§ 12), and 
Leibniz’s Rule follow as before. It is a useful exercise for the student 
to write these theorems out in detail and to give a complete and 
independent proof of each. 

Similar remarks apply to the integml 
h 

J * /(^. a) dx, 


where f {x, a) is continuous in the region 
R : a ^ X <. b, A ^ cn ^ B. 


If f [x, a) is continuous in the region 
R: a < X < b, A ^ Oi ^ B, 


the integral may be broken up into the sum : 



a <. c <. b, 


and each of the latter integrals treated as above. 

Remark. It would be a mistake to think that the above defini- 
tions exclude the case of proper integrals. The improper integrals 
are analogous to infinite series, the proper integrals to sums, so that 
a proper integral, under the above definitions, is like an infinite 
series whose terms, from a definite point on, are all 0, Because of 
this analogy the improper integrals are sometimes called “infinite 
integrals”, but the irrelevant connotations of such a terminology are 
too disturbing. 

Exercises 


1 . Show that 

x^ ^ dx = ^ dx ^ ^ dy^ 0 < ^ < ^, 

go ,0 g 
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I T dx = log — . 

J S 


2. Prove the last equation to be true by means of partial 
differentiation and Leibniz’s Rule. 

3. Let f {x, a) be continuous in the interval 

a <. X <. A 

for each a. of a point set and let ao be a point of condensation 
of A, Let 


lim a) = CO {x) 

{Xf, Oq) 


and let 


A 

J* fix, a,) 


converge uniformly in A. Then 


Urn I f (x, a) dx = I lim /(xy a) dx, 

a=cxQ tJ c/ a?=*oto 


§17. The Beta-Function. The Beta-Function is defined by 
the integral 


1 

n) = ^ 07^“^ (1 — x)^~’^dx. 


It converges for 0 < m, 0 < n, and is a proper integral when 
1 = m, 1 ^ n. Break the integral up into the sum: 


c 1 


0 < c < 1. 


The first integral, 


c 

^ (m, n)=J^ x'"-^ (1 - x)"-^ dx. 


converges uniformly in every region 0 < J ^ m, 0 < /i. 
For, if 

It (x) = (1 — x)~^ 
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0 < (1 - g iL W, 


and the fL (j;)-Test applies. 

Similarly, the second integral, 
1 

5) vj/" (m, /i) = ^ 

c 


dXi 


converges uniformly in every region 0 < m, 0 < cJ ^ 77. Hence 
the Beta Function is continuous throughout the region 0 < m, 
0 < 72. 

By a change of variable, 





X 


y 

1 -f r’ 


the Beta Function can also be written in the form : 


4) 


00 



(TTrT^’ 


It is connected with the Gamma Function by the relation, § 19: 


5) 


B (/7i, n) 


r (771) r (ji) 

r (771 + 72) * 


Exercise 


Show that the Beta Function admits derivatives of aU orders. 

§18. Both Limits Infinite. There remains the case of the 
reversal of the order integration in the integral 


1) 


00 00 

J f{x,y)dy. 


Let f {x, y) be continuous in the region 
il : 22 ^ X, h ^ y. 

We can obtain a test by means of the Theorem of Chap. V, § 10. Let 


' {x, y) =J'dx J f{x, y) dy. 
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Theorem. Let 


i) 


oo 


converge uniformly in any finite interval^ a ^ x ^ A; 


ii) 


f f^^^y) 


dx 


converge unifortrdy in any finite interval b ^ y ^ B ; 


iii) 


oo y- 


converge uniformly in the infinite interval, h S y 
Then each of the integrals 

oo oo oo oo 

fix, y)dx, J' dx J f (x, y) dy 

ha ah 

converges, and the two are equal: 

oo oo oo oo 

/ dy J* f{x,y)dx= J dx J' fix,y)dy. 

a ah 

Proof, From i) it follows that 

oo X 9 oo 

hms(x,y) =r dy f fix,y)dx—f dx f f{x,y)dy = <fix) 
ha ah 

exists. 

From ii) it follows that 

°° y y ^ 

Umsix,y)=J* dx J f{x,y)dy=J dy J* fix,y)dx = \^(y) 

ah ha 


exists. 

From iii) it follows, since 
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I J (ar", j) — s (a:', j) I < €, g S x', x", 

where ^ is independent of y. Hence all the hypotheses of the 
Theore^n cited are fulfilled and consequently : 

a) lim (f (x) exists, or 


oo oo 

J* dx j* f{x,y)dy‘ converges; 


b) 


lim yjr (y) exists, or 




oo oo 

f{xy y) dy converges ; 

\ a 

oo 00 oo oo 

c) J dx I f(x,y)dx=J* dy J* f{x,y)dx. 

a b b a 

Thus the theorem is proved. 

Corollary*. in particular, 

a ^ fix, y), 

and if 

oc 00 

/ f fi^<x)dy 

a i 

converges. Condition iii) is automatically fulfilled. 

For, let 

oo 

liix)= I* f(x,y)dy 
i 

Then fi (x) is continuous and ^ 0. Moreover, 

oo oo oo 

I' lt(x}dx=J dx J'fix,y)dy 

a a b 

converges. Hence the de la Vallee- Poussin (x)-test applies to the 

integral 


• This corollary, which is of chief importance in practice, is due to 
Professor C. A. Shook. 
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J 

y* F{x,y)dx, F{x,y) =J' f{x,y)dy, 

a b 

since 

V 

^ - j = J f{x^y)dy = /»■ {x). 

§ 19. Application. The B- Function in Terms of the V- Func- 
tion. The 5-function can be expressed in terms of the F- function 
by the formula : 

1) 

r (m -f w) 

The formal pajt of the proof is easily given. If in the F-integral, 
§ 1 5, we change the variable of integration from x to yx we have : 

F (m) = y^ e'~'^* dx. 

0 

Thus 

oo 

r (m) e-^ = J‘ x'"-^ yn,+n-l g-ra+x) 


OC oo OQ 

2) F (m ) ^ y^~'^ e~^ dy = ^ x^"'^ 

0 0 0 

provided it is pennissible to reverse the order of integration in the 
iterated integral. The value of the integral on the left is F (^z). The 
first integral to be computed on the right is substantially the F-integral. 
For if in § 15, 1), we change the variable of integration from x to 
(1 -f x:)y, we find : 


oe 




oo 

r(m)r(n) = r(m + n) J 

* A 
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But this last integral, by § 17, 4), is equal to B{m,n). 

It remains to justify the reversal of order in the iterated integral 
2). Consider first the iterated integral : 


5) j ^ I jm+n y(l+x) 

\ 1 

In accordance witli Condition i) of the theorem of § 18 the integral 

oo 

j e--r(l+x) 

*1 

converges uniformly in any finite interval 1 ^ :r = G. For, 


^m— ^ ym+n—1 

t, 

and the /t-test applies. 

Secondly, the integral 


OO 



yTn+n—l g ^2: 




converges uniformly in any finite interval 1 ^ ^ ^ G. For 

ym+n^l ^-y(l+x) ^ = p. U), 

and the p--test applies. 

Since the integrand is always positive and one iterated integral 
converges, Condition iii) is automatically fulfilled; i. e. we have the 
case considered in the Corollary. 

Thus the right to reverse the order of integration in the iterated 
integral 5) is established. Turning now to the integral 2), which is 
the one we are interested in : 


4) 



y.m+n—1 




0 0 

we see that we can break it up into the sum of four integrals; 


ccoo 1 ®® 0000 



The last integral is the one we have just discussed, 3). Each of the 
others, by a suitable change of variable of integration, can be brought 
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uDder the case considered in the Theorem of § 18. Thus in the 
first integral on the right we may replace x by \/x and y by l/r. 
We find : 




n-l dy. 


Heie, the exponential factor does not help in the convergence — 
naturally. But since we are integrating from I to co, there is no 
difficulty in obtaining each time a suitable ^-function. The further 
details are left to the reader. 

The example suggests the formulation of a general theorem, to 
which we now turn. 


§20. Rectang’ular Region of Integration. Consider the 


integral : 


A B 

J j 


where f{x^y) is continuous in the open rectangle 
Rx a < X < A, b < y < B, 

but is not necessarily bounded. We can paraphrase the theorem of 
§ 18 as follows. 

Theorem. Let 

B 

i) J 

h 

converge uniformly in any interi'ol 

a' S X = a < <. <. A \ 


ii) 


>4 

J /(^.r) 


dx 


converge uniformly in any interval 

hf ^ y ^ Bf, -b<bf<B<Bi 


iii) 



converge uniformly in the region b < y < B, 


b < t) < B. 
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Then each of the integrals 


S f f f fix,y)d-y 

q “ ah 

converges, and the two are equal: 

BA A B 

f dy j* flT^,y)dT= j dx l*f(x,y)dy. 

ha ah 

The proof ran be given by paraphrasing the proof of § 18, using 
the theorem of the Exercise, Chap. V, § 10, 

r 


fix, y) dx 


r\ i 

where lim (£, x) = {a. A), lim (ij, y) = [h, B).* 

A less elegant, but more elementary, proof consists in breaking 
the given integral up into four integrals: 


A B A B a B A ^ a0 
a h ^ ft ^ 8 ^ ^ ^ ^ ^ 


a < a < A 
b< <B 


and then transforming each into the integral considered in § 18. 
Thus the first integral on the right will be subjected, for example, 
to the change of variable: 


0/ = 


X — a 


A —X ' ^ B - y ' 

And sijiiilarly in the case of each of the other integrals. 




Corollary, 


If, in particular, fix,y) ^ 0, 
A B 



f(x,y) dy 


and if 


converges, Condition iii) of the hypothesis is automatkally satisfied. 

Finally, one or both of the limits of integration A, B may be 
replaced by -f c>o, and' independently either or both of the limits 
a, b hy — oo. 


• The proof was given in this way by one of iny students at Harvai*d, 
wliose name I cannot now recalL 
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§ 21 . 

integral 

1} 


Appraisal of an Altematinsr Integ'ral. 



sin X dx. 


where (p{x) is continuous, c S x^ and 


Consider the 


<p (^) ^ ^ c ^ x ' < x". 


lim <p (:c) = 0. 

X=oo 

Write : 


1 X^X 2 




X 



where xjf = kT and 


Xi — T ^ c < Xi, Xn £ X < x„ -h r. 

Assume first that c — — ir = xq. We then have an alternating 

series who«e terms are in general decreasing numerically (never in- 
creasing) and the general term approaches 0 as :i: becomes infinite. 
Hence the integral converges. Moreover, the error made by breaking 
off with an arbitrary x ^ c does not exceed 


J si 


sinxdx 


< 2f(c), 


or : 


2) 


X 

\J fW 


sSro: dx 


< 2 fie). 


c = j: < oo. 


The same appraisal holds when Xi t < c < x^. For, extend 
the definition of ip (a:) to the interval (jtq, c), setting 


<p{x)=^<p (c). 


Xi — T ^ X < C. 


Then, for the extended function, 

X 

^ <p {x) sin X dx 
c 


lies between 
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X 

^ ip (:c) sin x 


dx and 


X 

I* <p{-r) si 


sin:r 


and each of these inte^als is appraised by 2). 

With the same conditions for <p (x) the same appraisal is obtained 
for the integral 


J* if (x) sin {x + y) dx. 


In particular, 

5) 

Finally, m > 0 : 

4) 


X 

^ if (x) cos X dx 


< 2 (fie). 


5) 


if {x) sin mx dx 

c 

X 

j ip {x) cos mx dx 


< 


2 (c) 


2 if (c) 


Exercise 

Let (f {x, a) be defined in the region 
R : c ^ :r < oo, 0 < cn ^ A. 

Let ip {x, cto) be a continuous function of x for an arbitrary choice 
of cto > 0. Let 

i) if (x', (Xo) ^ «'o)> c ^ xf < a/' \ 

ii) lim ^(or, ao) = 0; 

iii) lim if (c, ot) = 0. 

ft =0 

Then 

oo 

CD (tt) = j if (x, (i)cosxdx 
% 


approaches 0, as a approaches 0. 
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09 

§22. Computation of f ^^dx. 

•) ^ 

0 

That this importaDt integral converges, is shown in the Calculus. 
Let its value be denoted by K. Since 

1 . . n • . sin(n+i)x 

i4-cosx + cos2:i:-f ••• 4‘Cosnx = — | — , 

2 sin V 

we see that 

/ sin {n-Vk)x ^ 

2 sin i X 2 * 

0 

Moreover, on changing the variable of integration from x to (n -b i)x, 
we have; 

C^^dx= 

%J ^ c/ ^ 

0 0 

Hence 

K — r (- ) sin (n + ^ sm dx. 

2 J \ X 2smix/ J X 

0 7C 

Now, change the variable in the last integral, setting 
r = (ti + J) X, A = (n + J) IT. 

Thus this integral becomes; 


/ sin t - 

—dt. 


and so approaches 0 as 71 = 00 . 

The first integral approaches 0 by Chap. VIII, § 1, Exercise 1 
Hence K — t/2: 


/ sin X 


§23. Applications. The integral 


“=/ 
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can be evaluated by setting 


0 

and reversing the order of integration in the iterated integral 

oo oo 

2) M = 2 dx ^ y cos mx dy. 

0 0 

For, by Example 1, § 14, 

oo 

/ ' 

y cos mx dx = -j/ir" 


and hence, by Example 2, § 14, 




dx 


It remains to justify the reversal of order in the iterated integral. 
This is done by the theorem of § 18. 


^ y cos mx dy 


converges uniformly, 0 ^ x, for 

1 y cos mx I S y = fi (y). 


oo 

cos mx dji. 


This is not so easy, for the uniform convergence cannot be established 
by means of the /t-test. 

For simplicity of presentation set m = 1 and consider the integral 


^y* y cosx dx. 


This is an alternating integral, and the value of the remainder can 
thus be appraised. The integral has the value : 


s^s- 
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where 


Since the function 



y e 0 < jx", 


is jnonotonic decreasing as x increases and has the limit 0, the value 
of the partial remainder 

xj 

J cos X dx, “ = £ < x', 

; 

is less numerically than the contribution of the arch in which £ 
appears : 

= £ < Z?, zz = A'lr — 2» A = A:r + 2, 


or: a = xjt, b ^ ^A+i- Now, 



cos X dx 


a. 


e dx = re 


Hence 


5) 



a <. X < b. 


For a fixed value of k (how- ever large) and a small value of 
y > 0 this appraisal will not be small ; but it will always be less 
than r. 

Let us formulate now what we wish to establish. To prove that 
the integral 4) converges uniformly in any finite interval 0 ^ y B 
is to show that to an arbitrary € >* 0 corresponds a g independent 
of y such that 


6 ) 


X 

j ^ y cosxdx 


< €, 




We can do this as follows. First 


X 

S 




cosxdx 
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is bounded for all values of 0 ~ x < oo : 


7) 

G>nsequently 


Of 

1 / 


e cos X dx 


< M. 


\j ye-. 

5 




< yM, 


no matter how xbe chosen. Let S be determined by the relation: 

8) MS = €. 


Then the condition 6) is satisfied when 0 = jy = S, no matter how 
X be chosen. 

Next, restrict y to the interval 
9) S < y ^ B, 

And now the appraisal 5) shows us that, if ^ be so chosen that 
V B < €, 


the condition 6) will be fulfilled. This completes the proof of uni- 
form convergence under ii) when m ^ 0. 

Turning now to iii) we have to show that 



dx 


converges uniformly in the interval 0 S ^ + oo, where 


y 

Fix.y)=J y e cos mx dy. 


It is easy to find here a function ft (x), namely : 


oo 

ft'(x) dy = 


2(1+ a:")’ 


This completes the proof when m ^ 0. When m = 0, the 
evaluation 3) is seen at once to hold by inspection of the integral 1). 
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Exercises 


1 . Show that 

’oo 

/ xs\x\mx , 

Z j o~ clx — 

1 + X- 


2. Show that 


OO 

/ 


Sin mx 


suggestion: Set m = 1, 


2 ^ » 


0 , 


^ p’n 

2 ^ » 


= 


0 , 


-f. 


0 < m 
m = 0 
m < 0 


0 < m; 
m = 0 
m < 0 


:r 



and apply the theorem of §20. 

This is, of course, an exercise in method. The result can be 
obtained at once from § 22. 

3. Show that 


no OO 

/ ysmky _ f* k cos hx , _ , _ 

¥TP =J ^ 

0 0 

by establishing the right to reverse the order in the iterated integral 

oo oo 

^ dx cos hx sin ky dy. 

0 0 

4. Show that 

X sin hx 


f 


k^ -f 


dx — 



§ 24 DuhameFs Theorem. In formulating certain physical 
quantities as limits of sums it frequently happais that the siun in 
question is nearly of the form of a sum whose limit is a definite 
integral, and it seems highly probable from physical considerations 
that the two variables have the same limit ; namely, the definite 
integral. Duhamel devised a theorem which meets the requirement. 
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Theorem 1. Let 

Ct*! + <X.2 + • • • + Ot'n 0 = a;fc , 
he a sum of infinitesimals which approaches a limit as n = oo. Let 

Pi + ^2 + ‘ ‘ * + P/I 
he a second sum such that 

lim— = 1 

in the sense of a uniform approach; Le. Pjfc/a^ ^hall approach the 
limit 1 uniformly as n = oo. Then the second sum approaches a 
limit, and the two limits are equal: 

lim (flCi + txo 4- • • • + a„) = lim -f jSo + • • • + p„). 

n =oo 71=00 

Proof. Let 

- = 1 + a. 

Then, by hypothesis, to a positive € chosen at pleasure there corre- 
sponds a fixed m such that 


Hence 


Ua 1 < €, m ^ n. 

Pi p2 "h • * * 4“ pjfc = Ct'l + Ct2 + • • ' 4“ O'n 
+ CCi Cl + Ot'2 ^2 "h ’ * * 4" 


Since > 0, we have: 

1 o^j Cl "h ^2 C2 4" ’ * ' 4" ct/i C/i I C®'! "h tK-i 4" * * * 4" €. 

The sum S is bounded, and so this last expression can be made 
as small as we please. This completes the proof. 

Another form of the theorem is the following. Consider a 
proper “definite integral: 

n K 

lim T f{x^ Axj = I Jix) dx, 

"=“*=1 •/ 


the integrand being continuous in the closed interval a ^ x ^ h. 
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Let be defined for each partition of. the interval and for each 
value of k ; and let 

^h—f d- Ca-» 

where approaches 0 uniformly ; i. e. to a positive € chosen at 
pleasure there shall correspond a fixed S such that 

I4i I < «. 1 1 < S, 

no matter how the interval {a, b) may be partioned. Then the 
sum : 

if I + (fi Axo + \- (fn Ar„ 

approaches a limit, and this limit is equal to the definite integral .* 



From a theoretical standpoint this latter theorem is more general. 
But in practice the earlier one is adequate, and more convenient to 
apply. Cf. the Author’s Introduction to the Calcidus, pp. 301-307. 
We may formulate the result as follo\\’s. 


Theoricm 2. Let % be a closed regular region of the n-dimen- 
sional space of the variables {xi^ • • *, Xn)<> and let f{xi, • • •, Xrt) be 
continuous in %. Consider the integral: 


= X/iAr*. 

V 7 J=eo 




Let be defined for each element of volume^ and let 

fk =fk + Lh 

where Ca a.pproaches 0 uniformly. Then 


ft 

*=i 

approaches a limits and 

litri I fdr. 

n=oc A=al ty U 


In attaching the name of Diiharnel to these theorems one recalls 
the man who first dealt constructively with the question stated at the 
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beginning of the paragraph. Duhamel himself formulated Theorem 
U without however recognizing the importance of the uniform re- 
striction — this question had not been raised in his time. On the 
other hand, Theorem 2 is only one of a group of theorems designed 
by iollowers of Duhamel to accomplish the same object. It might 
be better to refer to this whole group of theorems as DuhameVs 
Principle. 


§25. Line Integrals. Let C be a regular curve in the 
{x, -plane, and let f be 
a function, defined in the 
points of C and continuous. 

Thus y* is a continuous 
function of the length of 
the arc of C, measured 
from an extremity. Divide 

C up in any manner into n arcs as indicated, and form the sum: 



^^0 = 0 


n 


*=1 


where stnd fk'i^ the value of f at an arbitrary point 

s[ of the A:-th arc. Then the line integral of the function f along 
C is defined and denoted as follows: 




*=i •/ 


the longest arc approaching 0. It is nothing more or less, in 

substance, than the ordinary definite integral: 


2) 



ds. 


0 

But in form the definition is important; for, first, we are 
thinking of a function as defined along a curve., and not in an 
interval of the scale of numbers. And secondly there is no question 
of the sense of integration along C. We could equally well have 
measured s from the other end of the curve, or from a third point, 
in either direction. It is essential that be taken absolutely, not 
as a signed quantity. It is important to point out these facts at 
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this stage, since the value of ihe line integral 6) below depends 
essentially on the sense in which it is extended along the curve. 

Theorem. Let he defined in any manner, corresponding 
to the k-th element of arc, Asj^, and let 

=fi^k) + iky 

where 4a approaches 0 uniformly as n = oo. Then the sum 

n 

A=1 

approaches a limit as n = go, the maximum ^sj^ approaching 0, and 
5) lim y r fds. 

The proof follows at once from Duhamel’s Theorem, § 24. 

An important application in practice is the following. Let 
be defined as above, and let Ij^ denote the length of the chord. Then 
the sum 

^kh 

A=1 

approaches a limit as « = oo and 

4) lim y = r 

1^1 

For, let an arc of C be represented by the equations : 

X = vj/- (s), y=(o{s); 

( 5 )- + cd'(5)^ = 1. 

Then 

= Ax** + Aj*® = 

[ t'(^* + ®As*)* + a' (j* + 9'ASif ] As**. 

Here, 

5) y (s* + dAs*) = ^|/ (s*) + tj*. 


«' (s* + tf'As*) = a>' (s*) + 
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where rj/^, are uniformly small : 

1 1 < € and 1 I € if Asjt < S ; 

St independent of sj^. It follows, then, that 

~ [ 1 + 2 \)^' (Sj^) + 2 cd ' ( 5 *) i)jt + • 

The functions (s), oa' (s) are bounded . 

\yis)\ < Mt U'Wl < M. 

And, of course, 

k ^ 

Hence 

(1 - 2 Me) As^ < Q ^ Asl 

From this result it appears that 

4 = (l + £i)As*, U*l< — 

VI •~2M€ 

provided Asj^ < S, We infer, then, that 

= If Ca ] (1 + Ca) 

= [/ (^a) + 4a ] 

where c'/ can be made uniformly small by a suitable choice of (T, 
and hence the convergence comes under the case treated in the 
Theorem. 

§26. Continuation. The Integral: P dx + Q dy. 

C 

Let P and Q be defined and continuous along the curve C, and let 
C be divided into n arcs by the points yj^y /: = 0, 1, • • • , n. Let 

= Xk- -Tyt-l, A^i = 7* - r*-i. 

and form the sum: 

n 

X 7*) Aa^* + Q (J^*, 7*) A7jtl. 

Assl 
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Let n = oo, the longest approaching the limit 0. Then the 
sum approaches a limit, and this limit is defined as the line integral 
of P dx + Qdy, taken along C: 

6) lim y [P {xj,, yj,) ^.xj, + Q [xj,, yj,) A j;t] = T Pdx -^-Q dy. 




h- 



{XQ.yo) (x,. rO 


The proof of convergence is as follows. Measure the arc of C 
from the point (xo,j"o)‘ Then 

P yit) + Q yh) = 


{ PW^yk) 


As^ 


+ Q(^».n)^} A.,. 


I’he brace differs uniformly little from 

p yk) cos rj + Q (Xi, sin r^, 


because of 5), ard hence the convergence is ensured by the results 
of § 25. We see, moreover, that 


7 ) 



P dx + 


z 

Qdy =J {P COST + Q sin r) ds, 
0 


where s is measured from (xQ^yo) and r is the angle from the 
positive axis of x to the tangent in the sense of the increasing s. 

Unlike the line integral 1) the present line integral depends on 
the sense in which the curve C is described; for, the point (jtq, J'q) 
may be taken at either extremity. Another notation for this integral is: 
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where (a, h) = y^) are the coordinates of the initial point, and 

{A, B) are the coordinates of the terminal point. We see, then, that 

{a.h) U.B) 

9) j* P dx Q dy = — ^ P dx Q dy, 

{a,b) 

The extension ot* the definition of each line integral, 1) and 6), 
to the case of n dimensions is immediate : 


y* P dx Q dy -f R dz. 


and 


/ 


Pldxi-\‘ • • • Pn dxn. 


Green's Theorem.^ Let P P {x, y) be continuous in a region 
S and let dP/dy exist and be continuous in the interior of 5, and 
bounded. Then 




c 


the line integral being extended in the positive sense over the com- 
plete boundary C of S; cf. Advanced Calculus, p. 222. Similarly, 



• The Germans call it “Gauss’s Theorem” — and with equal justification. 
For Gauss, like Green, perceived its fundamental importance in analysis. But 
the one name cannot be preferred to the other on the basis of priority, since 
the representation (in three dimensions) of volume integrals by surface integrals 
goes back to Lagrange (1760/61): Oeuvrts vol. 1, p. 263. 
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5 C 

From these two equations it follows that 

//(If 

s c 

The proof of these theorems given in the Calculus is complete, 
provided the boundary is cut by a parallel to an axis of coordinates 
in a bounded number of points and line segments. It is possible to 
re;nove this restriction from the identity 10), which is the only one 
that concerns us here, without going into an intricate discussion of a 
limiting process, provided all the first partial derivatives of P and Q 
exist and are continuous within and are bounded. For, the identity 
10) is invariant of a rotation of the axes, or even, more generally, of 
an affine transformation. Let 


11 ) 


x> = aiX + biY + Cl 
y' = 02 X + b2y + C2 

and let P', Q' be determined by the transformation: 

f P = a, P' ■+ a. O' 

lQ = ii 


CLy ^ * 


12 ) 

Then 


and 


Moreover, 


P' + b2 Q' 

P'dx> + (^dy' = Pdx + Qdy 
9P SO , u^(SP' SO' \ 


J - 

S{x,y) 02 b 2 


sy 
^ 0 . 


If / > 0, then 


dP 

dy 




On the other hand. 
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14) 


y* p’dj + 
h 



P + Q dy. 


each line integral being extended in the positive sense around the 
complete boundary of its respective region. Thus the invariance of 
the identity 10) is established in this case. 

If, however, / < 0, Equation 13) is replaced by the equation : 


15) 


SJK 


dP ' _ dq' 

d/ dx' 


)■'''=-//( 

5 


dP _ dQ 
dy dx 



On the other hand, Equation 14) is replaced by the equation: 


16) Jj' P' dx' + (^ dy' = - 

since the positive sense of integration over the boundary of is the 
opposite of that in which the image of C is described. Thus the 
theorem is true in this case, too. 

Partition of S into Regions of Normal T'ype. It is possible 
to divide a region S into a finite number of regions of normal type. 
These consist i) of squares with their sides parallel to the coordinate 
axes and not exceeding in length a given fixed quantity, h, and 
moreover, lying inside of 5; ii) of regions defined by the following 
figures : 


./ 


P dx H- Q dy. 


Type I T"ype II 



The bounding curve in Type I can be expressed in the torm*. 

y =f {^) : 

and the two curves in Type II are grven by the equations: 

y = 9(x)< 

^[x) < fix), a < X b. 
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where f{x), <p (j:) are continuous, together with their first deriva 
tives, in an interval 


a ^ X ^ h, h — a <, k. 


Each of these figures can be rotated through any multiple of 

It may happen that the boundary C of 5 is cut by a parallel to 
an axis of coordinates in an infinite number of points and line seg- 
ments. But on rotating a given region of normal type through a 
convenient angle, the new figure will have a boundary which is cut 
by such parallels at most in a bounded number of points. 

For the transformed figure the proof of the identity 10) is that 
given in the calculus. By the theorem of invariance just established 
the identity holds for the original figure. And now the identity 10) 
for the entire region S, with its boimdary C, is obtained by writing 
it down for each region of normal type, and summing. 


dP dO 

The Condition: ^ . 


Let «S be a closed regular region. 


Let P and Q be continuous in S, and let their first partial deriva- 
tives exist and be continuous at all interior points of and bounded 
in S. 

Let S be any regular closed region contained in 5. Consider 
the integral: 


17) Pdx Q dy, 

r 

extended in the positive sense over the complete boundairy F of S. 
From the identity lO) it follows that, if 


18) 


dP _ dQ 
dy dx 


at eveiy interior point of 5, then 


19) 


jp,. 


r 

Conversely, if Equation 19) bolds for an arbitrary S then 18) is 
true throughout the interior of S, 


* A detailed proof of this theorem of partition is given in tbe Author’s 
Funktionenthecriey vol. I, Chap. V, § 9. 
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These results serve as the basis of the discussion of the funclion 
defined by the line integral: 


20 ) 


(*.r) 


= f Pdx + Qdy, 


P and Q satisfying the condition 18) ; cf. the Advanced Cakidus, 
pp. 222-233, and the Funktionentheorie, vol. I, Chap. IV. 



Chapter X 

The Gamma Function 


§ 1. Definition. The Gamma Function has been defined in 
Chap. IX, § 15 by means of the integral: 


1 ) 


(*)=/. 


* e ^ dt. 


The integral converges absolutely for ajl positive values of x and 
uniformly in every interval ^ S x ^ 6r, where G is arbitrarily 
large and S is arbitrarily small. Thus T (x) is continuous for all 
positive values of x. 

The function possesses a derivative, given by Leibniz’s Rule: 

oo 

2) J* log t dt, 

0 

Moreover, 

oo 


d^T 


and so we see that 

for all positive values of x. Hence the graph of the function: 

5) r = 

is concave upward for all positive values of x. Furthermore, 

6) r (0+) = -f oo, r (+ oo) = + CO. 


The first relation follows from the fact that, for small values 


of X. 
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The second relation is a result of the fact (cf. § 2) that 

7) r(n + l) = n!, 

combined with the fact just established, that the curve is concave 
upward. 

Finally, we note that, from the definition 1): 

8) r(x)>0, 0<;r. 

Also 

9) r(i) = i, r(2) = i. 

The first of these last relations is proved by direct evaluation of the 
integral 1). The second follows from 7) by putting n = i. 



The figure shows the graph of the function 

j = r(x + 1), 

the dotted curve representing the function d log F (a; + \)/dx\ cf. 
Duval, Annals of Math, 2d. ser. (1903/04) vol. 5. 

The graph of 5) is thus seen to have one and only one minimum, 
and this occurs for a value of x between 1 and 2. The value of x 
h'ls been found to be : x = 1.46163 • • • 
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§2. The Difference Equation. The Gamma Function obeys 
the law : 

1) r(.r + 1) =xr(a:). 


This is known as the difference equation. It is proved at once by 
integration by parts: 


/• 




r/ 


e ^ dt., 


0 < X. 


A first application of the difference equation consists in setting 
X equal successively to the natural numbers: x= 1,2,3, ••• and 
observing that F (1) = 1, cf. § 1, 9). 

A second application enables us to define F (x) for negative values 
of X. Wriie 


2 ) 


F(x) = 


F(x H- 1) 

X 


The right-hand side of this equation has a meaning when — 1 < x <C 0. 
This shall be the definition of F (x) for — 1 < x < 0. It thus 
appears that 

F (x) < 0, - 1 < X < 0, 

and continuous, the graph having the lines x = 0 and x = — 1 as 
asymptotes. 

Repeating the process, setting — 2 < x < — 1 in 2), we define 
F (x) in the latter interval. The graph of the function is shown in 
the figure. In any panel, — (^ + 1) < x < — A:, the curve is 
always concave downward when k is even, and concave upward when 
k is odd. The proof is given conveniently by means of a later 
result; cf. § 3. 

§ 3. Gauss’s Product. Gauss* based his treatment of the 
Gamma Function on the following product, which he denoted by 
n (n, x). We shall show in § 4 that the limiting function is the 
function F (x) defined in § 1 . For the present we shall write with 
Gauss : 


1) 


n (n, x) = 


1 - 2 - 




X (x + 1) (x -f 2) • • • (x -h /I — 1) 


♦ JVerke^ vol. Ill, p. 144. The date is January 30, 1812. 
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where x has any real* value ^ 0, — 1, — 2, • • •, and prove that, 
as n becomes infinite, T1 (n, x) approaches a limit. This limit wc 
will denote by T {x ) : 


2 ) 


r (x) = lim n (n, x). 

n=x 


The Convergence Proof, 
in the form: 

i) 11 («, x) = IT (2, x) - 


The variable Tl (n. x) can be written 

n(3,:r) n(4,a:) n(n,:r) 

li(2,:r) 11(3, a:) * “ D - l,:r) 


1 ^ 2^ 2»3.^ 3;4f {n - \)n^ 

X X \ {x + 2)2^ (j? + 3) 3* (x -i- n -- 1) {n — iy‘ 


If, then, we set 

4) 

w'e have 


fn {^) — 


D* ^ (1 

{x n)n^ 1 + ^ 


5) 


li.nn(.z,:r) = ~n/n(^)> 

^ 77=1 


and the question, of the convergence of IT (tz, x) becomes the question 
of the convergence of this infinite product. But we have methods 
for dealing with this latter question; cf. Chap. I, § 10. 

Consider the series of logarithms: 

oo 

'% log/n {x). 

n—m 

Here, 

log/nW =^log (^ + ~) ~ 


The convergence of this series is established at once by compauring 
its terms with the corresponding terms of the known convergent series: 


oo - 

Si 


77=1 


* The convergence proof applies at once to the complex domain, x being 
replaced by saax + yrV — 1. 
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and applying the theorein of Chap. 1, §2: 

li,n = £1^ . 

n=oo V ^2 2 

The value of the U nit is not important — only the fact that a limit 
exists. 

Thus the convergence of H (n, x) is established and a function 
r (:r) is defined by 2), or : 

, - ('+-)' 
rw = -n- " 


6 ) 


X 71=1 


1 + 


Properties of T {x). Since 

n(n, 1) = 1 

for all values of n it follows that 


7 ) 


r(i) = 1. 


Next, observe that 


n (n, X + 1) = 


nx 


n (n, x). 


X n 

Allowing n to become infinite we have the Difference Equation: 

8) r (:r + 1) = X r (x). 

Notice that this result holds for all values of x ^ 0, — 1 , — 2, • • • . 
In particular, 

9) r (n + 1) = « ! , n = 1, 2, 3, • • •. 

A further relation satisfied by the F- function is obtained from 
the product: 


n (n, x) n (n, — x) = — 
1 


{n 1 )! 


x^ (1 — or) (2“ X-) • • • ( [az — Ip — x^) 

1 


Allow n to increase. The denorninaior corresponds to the infinite 
product for the sine- function. Chap. VI, § 6. Thus 


10 ) 


r (x) r (- x) = - 


xsm Tx 
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Another form of this relation is : 


11 ) 


r U) r (1 - :r) = ■ 


sin Tx 

Fn particular, from this last relation follows that 

12) r(i) = i/ir 

Differentiation. I’he F- function is given by the series: 

13) log r (:r) = — log:r + 

{ xlog ( ] + -i) - log (x + n) + log n } , 

n-=l 

when X > 0. The term-by-term derivative series represents in all 
cases the loajarithmic derivative: 


14) 


x) X Yi j X n i 

n=l 


r(x) 


This latter series converges uniformly in any interval 

-G ^ X ^ G, 

from which the points x = 0, — 1 , — 2, • • • have been removed. 
For 

log ( 1 + — ) = { log (1 + S - — } + ^ / • 

V n/ X + n I n n * n{n x) 

If, then, we choose the Mn of Weierstrass’s M-test as follows: 

G 


"• = |'»«(’+v)-7 


■f 


n{n - G) ’ 


G < n. 


we see that this series converges by comparing Mn with \/n^. 

It is now easy to complete the proof that F (x) has a derivative 
for all vedues of x for which the function is defined. Moreover, the 
F- function has a second derivative given by differentiating 14) : 

r"(x) _ / r'(x) \^ . V 1 

r(x) V r(x) 7 (x + n)2 • 


15 ) 
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Since the right-hand side is always positive, it follows that T^^{x) 
and r (:r) always have the same sign. Thus the graph, § 2, is 
concave upward (downward) when T {x) is positive (negative). 

Euler's Constant. The development 6) can be replaced by the 
lollowin^: : 


16) 


V{x) = 




n 


1 




where C is Euler’s Constant 
17) 


C — lim log n | . 

*-2 3 n J 

he value : 

f A 1 ^ 

+ 7l) ^ " 


For, the product in 6) has the value : 


This product can be written as the quotient of two infinite products. 
Since 

log{(i +l)V#}=-x[l-log(l+l)], 

it is clear that the numerator product has the value The 

value of C is : 

18) C = 0.57721 56649 01532 86060 • • • 


Because of 16) we can write: 


19) 


1 

r(:r) 




The product on the right converges for all values of x, real or 
complex, and it defines a so-called entire function of the complex vari- 
able, i.e. a function that is analytic for all finite values of the 
argument. In particular, it appears from either 16) or 19) that the 
T-function has no roots, even in the complex plane. 

We have in the above another example of a convergence factor 
whereby a divergent product, 
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is rendered covergent : 



e n 


without disturbing the roots of the individual factors; cf. Chap. 

VI, §6. 


Exercise 


Prove the uniform convergence of the series 14) by means of 
the series 15). 

§4 Agreement of the Two Definitions. From the 
relation : 

( t 

TTl ^ 


it is easy to surmise that possibly 


20 ) 


lim ^ i dt 


0 0 

The proof of the correctness of the surmise is not difficult. 

f {t, m) = (l 

' m ' 

m) = 0, m <, t <. oo. 


{x). 


Let 


Then the first integral in 20) can be written: 


21 ) 



0 


Here ; 


lim f {t, m) = 


If, then, the integral 21) converges uniformly, the relation 20) re 
suits ; cf. Chap. IX, § 20, Since 


V m / 


0 < r < 7/1. 
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it is seen that 

0 ^ f {t^m) < 

for all values of t and m, I’hus the integral 21) satisfies a /t-test: 

-- 

and the proof is complete. 

The integral — we now change the notation from m to n — 

/"-■(■ - 7 )”- 

0 

can be evaluated explicitly and turns out to be equal to 


1 


x{x + 1) - -{x n) 

For, change the variable of integration, setting t = nX. Then 

n 1 

J " (l - dt = - >.Yd\. 

0 0 

To this last integral apply the method of integration by parts : 
1 * 1 
rx*-i(l _ x)«dX = — • • • • — r-^ T 

^ ’ x^+1 X -^rn - \J 

Thus finally 


/■ 


f 1 ^ dt = — - — n (t, n). 

V n ^ X n 

Allow n to become infinite. It appears, then, that 

oo 

y* dt = lim Tl {x^ n). 

0 

Hence the two definitions lead to the same function, T (or). 

§5. Stirlinsf’s Formula. For large values of x the function 
r {x) is extremely large. Its value can be computed approximately 
by the evaluation 


1 ) 


T(x) = ^/' 2 TX^ 2 e''^e'^^^K 
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where 


2 ) 

or 

3) 


uj (x) = 


0 < BJ (x) < 

0 


12x ’ 


12 X 

0 < 0 < 1 . 


Equation 1) is known as Stirling’s Formula. We mention also 
the following evaluation for the factorial : 


4) 


n\ = ■]/2ir e , 


0 < < 1 . 


An elementary proof of the truth of 1) where 0 ^ 0 ^ 1 can 
be given as follows. 

Let C3 {x) be defined by 1 ) : 

5) zs {x) = Ing r f:c) 4- ^ — i) log x — log -j,/ 2^. 

Since 

r u -h 1) - r (x) 

it follows that 

6) toU)— (x + 1) = ^ log (l + — ) — 1. 

Remembering that 

3 5 J 



^ 7 

11 

and setting 

1 

1 -f — = 

X 

1 -4 r 

1 -r ’ 

we find: 



log (l 

1 — ^ ( 

1 

^ 2x 4 1 V 


r- 


1 

2x4-1’ 


• cf. the excellent treatment of this subject by Godefroy, Theorie element 
taire des series y Chap. VI, which we here reproduce. The reasoning does not 
show that 0 G 1, but only that 0 0 ^ 1. There is, of course, no loss 

in this less general theorem for purposes of computation, since Q, in the more 
general form, might conceiveably lie so near to 0 or to 1 that the difference 
would have no effect on any approximate computation. 
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- < iog(i + ^) < 2^ (i + 


It follows, then from 6) that 


7) 0 < 03 (x) - ra (x + 1) < -f ) . 

12 V X X + 1 / 

By a repeated application of this formula : 

0 < u5 (j: + 1) — C3 (:r + 2) < —( 

^ 12Va:+l :r + 2/ 

0 < cD(a: + /2 — 1) — co(x + n) < — ( ^ 

^ ^ 12\x ^ n - 1 or + Ti/ 


v\'e see that 


< C3 (x) — 03 (x + n) < ) . 

12 V x X n ^ 


We now proceed to show that 

9) lim cs {x) = 0. 

X=co 

It will then follow from 8) on letting n = oo that* 

10) 0 ^ 03(x) g 


C3 {x) = ■ 


0 g 0 < 1. 


Proof of 9). First, let a: = n in 8) : 

11) 0 < cs (n) — ^ (2n) < — . 

24 n 

We now introduce the function \)f (x) : 

12 ) 

i/23rx*-5e-' 

Godefroy infers at this point that 

0 <.(,)< 4 -. 

This relation is true, but his reasoning establishes only the less general 
relation 10) or 10^). 
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Then 

13) 


05 (x) =; log xjr {x\ f (x) = e^(^K 


Since 


^ ^^) — ^m(n)—co(2n) 


it follows from 11) that 


4 ^ ^(n) ^ — 

1 < A - - ; < ^24n- 


\lr(2n) 


Hence 
14) 

Next, form the function 


lim Jp- = 1. 


'jfjnf 


'jr(2n) ■ 

We shall show by direct computation that 


r (n)^ 4 


15) 

It will follow, then, from 14) and 15) that 

lim\(r(n) = l. 


The proof is as iollows. From the definition of N^(a:) by 12) 
and the property of the F-function : 


we have : 

17) 


r(7i + 1) = nl 


\|/’ (n)^ _ 1 2-4*6 • • - 2n 

Recall Wallis’s formula for t: 


2 “'T 3 3 5 5 7 



2'4-6 

1-3-5 


2n Y 1 
( 2/1 — 11 / 2 // + 1 ‘ 


It thus appears that the right-hand side of 17) approaches 1, and 
thus 15) is established. We see, then, that 16) is true. 
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Finally, we will show that, for an arbitrary x > 0, 


18) 


lim = 1. 

[x + n) 


We have : 


Now 


and 


f(n) _ (n— i)!e^ (x + 
vjr (x + w) r(x + n) ' 


r,»-4 ^ n J 


T {x n) = X (x -h l)“*(x + n— l)r U). 
Remembering Gauss’s product: 

r (x) = lim 1-2- ••• -(«- 1) ^ 

MOO j:(ar+l)***(:c4-n — 1) 
we infer at once the truth of 18). 

From 16) amd 18) it follows that, for an arbitrary value of 

X > 0, 

lim (x + 3^) = 1 . 


Hence, from 13), 


lim cc (j: + n) = 0, 


and now 8) yields 10), hence 9) — the relation we set out to establish. 
The proof of 1) under the appraisal 

0 g C3U) ^ 1 
or 

.w = -|_, oa.s, 

is complete. 

Gudermann's Formula. On writing down Equation 6) for x, 
X -h 1 , • • • , a: + n and adding we find : 

a,(x) - ns(x + n + 1) =ij(x + 2Z^)log(l + ^) _ l] 

Allowing n to become infinite and remembering 9) we obtain 
Gudermann’s Formula : 
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.9) .(,)=j[(x + ?!!±i)tog(l+^)_,], 

Binet's Series, The general term (x) in 19) can be written 
\n the form : 

■*.(X) = (X + .) l„g(, + _ , + lbg(, + 

= + 1__L +... 

2 :c 4- n 3 (:r + 4 (x + nf 

+ -L » -1 ' I ■ 1 

2 X + n 4 {x + nf 6 {x + nf 


= X(-1)'’ 


ip + i)-2p {x + n)P 


u ^.x)- ^ ^ ^ I ^ ^ 

" 3-4 (x+nY 4-6 (x + nf 5-8 {x + n)* 

By virtue of the theorem of Chap. VII, § 5 we have : 

ont / N _ 1 1 2 ^ 1 

^ + 4.6Z^4.„)3 


L. v_JL__ ... 


Another form for u„ (x) is the following : 
u„(x} =-{x + n+ l)log(l - ^ 

+ ^ log f 1 - 1. 

2 \ or-hn+l/ 

This form leads to the development : 

= w = wi + A i, (^Tiy 

, 5 y 1 


21 ) 
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Exercises 


1. Give all the details in the above deduction of Formulas 20) 
and 21). 

2. By meains of 20) and the evaluations of the series 


1 1 1 
2 ^ 3 ^ 


;> = 2, 4, 6, • • • ; 


J_ + L_+... 

(m + ^ 

given in Chap. 1, §4 and Chap. VII, §7 obtain appraisals for ts{m) 



Chapter XI 
Fourier’s Integral 


§1. Fourier’s Integral. Heuristic Treatment. Let / (x) 

be continuous in the interval — oo <, x oo save for isolated 

values, and let 

oo 

1) J |/(x) I dx 

—OO 

converge. Consider an arbitrary interval 

2 ) -I < X < I 

By means of the transformation 


3) 


y ^ 

T - T 

the function goes over into a fimction of y: 


4) 


/(x) = F(j), 


having the same properties. In particular, the integrals that define 
the Fourier’s coefficients of Fir) \vill converge: 


7i 

5) ^ F (y) cos ny dy, bn^ — J* F (y) sin ny dy. 

— n — 

Thus a Fourier’s development* of the function F {y) exists: 


6 ; 


^ 71 = 1 


or 

^ oo 

7) C F (jr) ^ C F (s) cos 72 (j — y) ds. 

We will now transform back to the vciriable x by 3). Thus we 
are led to the development : 


* We apply the term development to denote the series 6), irrespective of 
whether the series converges and represents the fimction. 
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In order to bring out the central thought in the investigation 
that follows, let us confine ourselves for the present to those functions 
of the class before us, of which we know that they can be expanded 
into a Fourier’s series; i.e. the series 7) and hence the series 8) shall 
converge at all points of continuity to the value of the function. Thus 
if /(x) satisfies the conditions of §1, Chap. VIlI, this will be the case. 

Formal Deduction of Fourier* s Integral, Let 


9 ) 


Aa = -y . 


The series in 8) now takes the form: 

I 

1 ** 

I \ 

10) 


1 r 

— ^ f f(t) cos n Act (t -- x) Aa dt. 

^ if 

Jf we consider a function ^(a) continuous for 0 S a, and divide the 
interval *0 ^ a ^ A into m equal parts, Aa = A/m^ then the sum 

m 

11) 5) IP («•!.) Aa 


n=sl 


approaches the limit 

12 ) 

when m = CO. The series 


A 

J* if' {a) da 


^ if (ctn) Aa 

when Aa approaches 0, suggests the integral 

0 

9 

ip (a) da. 




Thus the expression 10), when I becomes infinite, suggests the 
integral: 


13) 


oo oo 


(t) cos a (t — x) dt. 
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This is known as Fourier* s Integral, It converges, under suitable 
lestrictions, to the value f (x). 

§ 2. A Lemma. Lemma. Let the function c {x) be continuous 
for 0 <. X oo^ save for isolated discontinuities ^ and let either 


i) 

converge absolutely; or 
ill) 


Jvi 

0 

G 


x) dx 


(x) dx 


converge absolutely^ where G is an arbitrary positive constant; 
ii 2 ) ip (x) decrease monotonicaUy toward. 0 as x increases : 

r if (x^) ^ ^ (x"), 0 ^ A <. x^ <, x"; 

( lim ip (x) = 0, 


where A is some fixed number. 

Let ip (x) approach a limit when x approaches 0 from above • 


lim ip (x) 
r=o+ 


and let 


^ (0+), 

iL (x) — (0“^) 


he bounded at the origin. 

Then 

oo oo 

I doi I ip {x) cos uxdx 
0 0 

converges to the value f ^(0*^). 

We will prove the lemma first for the simplest and most im- 
portant case, namely, that ^(x) has no discontinuities* and satisfies 
Q>ndition i). Here the integrand (if for the present purpose ^(x) is 
defined as ip (O"^) for x = 0) is continuous in the region 
jR O^x, --oo<a<4-oo, 

and the integral 


• The proof applies, however, to the case that ip{x) has isolated discon- 
tinuities and is bounded at each one of tiiem. 



330 


FUNCTIONS OF REAL VARIABLES 


14) 


(p (:r) cos 0 


ouxdx 


converges uniformly for all values of a, as is seen by setting 

U) = 1 f W 1- 

Hence 14) represents a continuous function, and furthermore 

/ oo oo 

da ^ (p{x) oosaxdx^ ^ (p (:r) dx, 

0 0 0 

We proceed to show that the integral on the right of 15) con- 
verges toward f <p (O"^) when q tends to infinity. Write 

16) J,p w dT = <f (0+) dx 
0 0 

+ I — — - sm qx dx. 

V 

Since, by Chap. IX, §22, 

oo 

17) f^dt = ^, 

J t 2 

0 

we see on making the change of variable t qx that the first integral 
on the right of 16) has the value f ^ (O'*"), no matter what value q 
may have. 

The second integral can be written: 

18) + 

0 

oo oo 

^lMsinqxdx-f{0^) f ^^dx. 

Let € > 0 be chosen arbitrarily. Then h can be so determined that 

oo oo 

I S ~ ^ Jl* \ip{x)\dx < €. 
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Moreover, 

oo oo 

h qh 

and so 

or 

— (p (0+) ^ dx < ^ = 9 . 

h 

As regards the first integral in 18 ), its limit is 0 as 9 increases; 
cf. Chap, Vm, § 2 , Ex. 3 . Hence it remains numerically less that 
€ when 9 ^ and so the whole sum 18 ) is numerically less than 
3 €. This completes the proof. 

Exercise 

Let c (x, £) be continuous in the region 

0 <a:<oo, A ^ i ^ B, 

Let the limit 

lim (p{x,i) = f (0+, £) 

exist for each $. Let ^ ( 0 +, 4 ) be bounded. Let the function 

X 

be bounded in the region 

0 <:r<c, A S I ^ B, 
where c is a positive constant. Finally, let the integral 

00 

^ I ^ (x, I) 1 dx 

0 

converge and be bounded. Prove that the function of (9, £) 
represented by the integral 13 ) converges uniformly in the interval 
A ^ ^ ^ B when 9 = co. 

Suggestion.. Appraise the integral 
h 

^ (x, $) sin qx dx 
0 

by assigning an arbitrary € > 0 and dividing the interval 0 ^ x ^ h 
bv the points 

Xq = 0 < Xj < • • • < Xn^i < Xn^ h. 
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so chos«i that, if 

^ O = ^ 0 + C*. Xf, ^ X ^ 0 ^ k < n. 


we have: 


ik\< €. 


§ 3. Continuation. The General Case*. We turn now to 
the most general class of functions (p (x) admitted by the Lemma, 
and proceed to establish 15), §2: 

/ oo oo 

da ^ <p (x) cos ax dx =z j* (p (jr) 

0 0 0 

First and foremost it is seen that the integral 


• (x) cos ax dx, 0 < k, 


converges, since t {x) is continuous except for isolated singularities and 


n 

J* 1 f (a^) 


converges. G)nsequently 


(x) cos a r 


converges in Case i) because it converges absolutely, and in Case ii) 
because it is an alternating integral. 

The function defined by this integral. 


00 

M (<*•) =J* 9 (■ 


x)cosaxdx, 0 < a. 


is continuous. For 


n 

to (ao + Aol) — 00 (oto) = ^ (x) [ cos (do + Aa ) x -- cosaQx]dx 


• It is well to defer the study of Uiis section till the rest of die chs^iter 
has been completed. 
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oo 


(x) cos (ao + Aa) x dx — 



cos a^^xdx^ 


0 < ao» 0 -< ao + Aa. 


Each of these last two integrals can be made less numerically than € 
by a suitable restriction of Aa and a pi-oper choice of h, as follows. 
In Case i) it is sufficient to choose h so that 



dx <. 




h 

no restriction on A a being needed. 

In Case ii) let y be chosen so that 0 < y <1 olq, and let A a 
be subject to the restriction ao + Aa > y. Let h A, Chap. IX, 
§21. Then, since, 


22 ) 



{x) cos (ux dx 


h 

it is enpugh to take h so that 


^ 2w{h) 

a 


23) 


w < 

y 


0 < a. 


Since h is now a constant, it is possible further to restrict Aa 
so that the first integral in 21) remains numerically less than €, 
when I Aa | < ; cis is seen on removing from the interval of in- 

tegration (0, h) short segments including the points of discontinuity 
and applying to the contributions to the integral arising from these 
the appraisal: 

24) cos (ao + Aa) a: — cos ao = — Aa sin (ao -4- 0 Aa), 


The proof of the continuity of <o (a), 0 < a, is herewith com- 
plete. a> (a) is not, however, necessarily bounded, as is shown by the 
example 

> oe 

dx = -^ f S^dt. 

V~x a 0 V t 

Next, we need to show that the order of integration can be re- 
versed in the integral 
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25) 




> {x) cos (tx dx. 

r 0 

The proof is not difficult and can be left to the reader. 

We are now prepared to show that the order of integration can 
be reversed in the integral 


26) 


/ oo 

dcjr 


{x) cos ax dx. 


0 < y. 


7 0 

W’rite the inner integral in the form: 

h 


I cos ax dx -h 


^ ip {x) cos ax dx = ^ ip {x) < 

0 0 
Choose g in Case i) so that 

oo 

J' \<p{x)\dx < € ; 


OO 

y* fix) 


cos ax dx. 


in Case ii) so that g ^ A and 

2 fig) 


< €. 


Then 


oo 

I fix) 


cos axdx 


< €, g = h, y ^ (t. 


Thus we see that 


q oo 

^ da ^ ip {x) cos ax dx — ^ ip {x) dx j cos ax da 


q oo 

j da ^ ip (x) cos ax dx^ < “ y) g ^ h. 

Y ^ 

This proves that the order of integration in the integral 26) can 
be reversed, and hence we infer the relation: 

9 


28) 


s ^ 


cos axdx = 
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0 0 

The last integral in 28) approaches 0 with y. For, 

oo h oo 

29) J* <p {x) - dx= ^ ip (x) dx -{-J* (p {x) - dx, 

0 0 A 

Let € > 0 be arbitrary. In Case i) it is sufficient to take h so that 

oo 

J* I <P (•»•) \dx < (. 

h 

In Case i\) h A can be so chosen that 


CO oo 71 


< €. 


And now, holding h fast, we see that y can be so restricted that 
the first integral on the right of 29) remains nuriierically less than €. 

If, then, in 28) we allow y to approach 0, the right-hand side 
approaches the first term as its limit. Hence the left-hand side con- 
verges and we have 19), or : 

(f oo CO 

30) ^ da ^ if {x)oos ax dx = J* ip {x) dx, 

0 U 0 


The final step consists in showing that the integral on the right 
converges toward f <p (O'*") as q increases. The proof begins as in § 2 
and we reach 18). In Case i) the last two integrals can be appraised 
as in the earlier proof. In Case ii) we have, by Chap. IX, § 21 : 


^ £^£1 sin qx dx 
h 



A g //, 


since the function ip {x)/ x decreases monotonically toward 0 as a:: in- 
creases. It is sufficient, then, to choose h so that 


, 

h ’ 


A ^ h. 


The third integral in 18) is appraised as before, and so, in each case, 
there remains only the first integral, with h fixed. With the aid of 
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the Exercise of Chap. VIII, § 2, there is no difficulty in proving that 
this integral remains nnmerically less than € when q exceeds a suit- 
able integer, ^ q, and the proof of the Lemma is now complete. 

§4. Convers^ence of Fourier’s Inte^rraL Differentiation. 

The most important functions which can be represoited by Fourier’s 
integral belong to one or both of the following classes. 

Class I. yix') is continuous except for isolated singularities and 

oo 

J* l/U) 1 

— oo 

converges. 

Class II. f{x) is continuous except for isolated singularities and 

h 

a) ^ \f{x)\dx 

a 

converges, where a, b are two arbitrary numbers; 

P) f{x) converges monotonically toward 0 when x = + oo, and 
also (though not necessarily with the same sign) when x = — oo. 

Theorem of Convergence. Let f[x) he a function belonging 
either to Class 1. or to Class II. Let x be a point such that 

lim f{t)=f (x+), lim f{t)=f {x~). 

t=x+ 

Let each of the difference- quotients : 


f{x + h) —fix'*') 

h 


0 < A < 


- S < h < Q 
h 


be bounded. Then 


J. ^ d(X ^ f (f) cos a (f — a:) J [f'{x^) + / (a; ) ]. 

Ify in particular the function is continuous at the point x^ then 

oo ' c» 

fix) = 1 / da Jm cos a (^ — ar) dt. 
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The proof follows immediately from the Lemma. Make a change 
of variable: 

u = t — X. 

Then 

oo oe 

//M cos — x) dt = //< X 4- u) cos au du. 

X 0 

<P =/U + w), 


Set 


and apply the Lemma. 
Next, let 


^ = — w. 


Then 


Set 


X oo 

^ f {t) cos Oiit — x) dt ^ ^ f{x — u) cos ftu dll. 


<p{u) —fix -- u) 

and apply the Lemma. Thus the proof results. 

Differentiation, Let f {x) be a function which meets all the con- 
ditions of the above theorem and, furthermore, is continuous without 
exception. Let it have a derivative which also satisfies the conditions 
of the theorem. Then, in an interval a <. x <. b in which the 
derivative is continuous, it will be given by the integral: 

oe oe 

(x) = — ^ da^ ^ f' (r) cos a (r — x) dt. 

0 —oo 

For, we can write Fourier’s Integral in the form : 

3C OC 

f {x) = — ^ dos ^ y*(w 4- x) cos Oiu dll 4- 


oo 0 

da, w 4“ J?) cos a,udu^ 


and each of these latter integrals can be differentiated by Leibniz’s 

rule. 
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§5, Derived Integ'rals. It is possible to break the Fourier’s 
integral up into two integrals as follows: 

oo CO 

f (x) = ^ f{^) cos Oi {t — x) dt =• 

U — oo 

cc oc oo oo 

lj‘cosaxrfaj*/(0 COS at dt + rf s\n ax da Sf [t) smatdt. 

0 — oo 0 “OO 

In case f {x) is an even function or an odd function these in- 
tegrals can be simplified. 

Case 1. /(:r) =/(— x). Here the last integral vanishes and 
the first can be written in simpler form : 

oo oo 

/(^) = -^ / cosax da Jm cos atdt, 

^0 0 

Case II. f{x) = — /( — x). Here 

oo oo 

sinaxda ^ f{t) sm at dt. 


Example 1 . Let 

f{x) = 0 2 a:, 

f[^x)^f[x). 
This example comes under Case I. Since 


0 < 4-; 


/ e ** cos dfr = — o , 

k’' + 0L“ 


oo 

2 r kcos ax , 


0 ^ X, 0 < A. 


/ cos a 

ft; 




4^0. 
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Example 2. Let 

fix) = e-*', 0 g X, 0 < /I ; 

/(- x) = - fix). 

This example comes under Case II. Since 


e sin at clt = y 5 ~; o , 

A" + 01“ 


we have : 


cc 

2 /* a sin , 


< a:, 0 < A-. 


Thus if A 7 ^ 0 : 


oo C fc-'*'', 0<x-, 

/ asinax , „ „ 

-pr-, 5 da. = < 0, X = 0 ; 

k- + a.- I 

® l-fe-'**', x<0. 

Example 3. Let 

fix) = x“*, 0 < X, 0 < A < I ; 

/(- =/W- 


or oc 

07“* = — ^ cosax da ^ cos at dt. 


Change the variable : at. Then 


oc oo 

- ot*“^ cosctoro^ot vT^ Qosudu, 


In particular, if a: = 1 : 


oe oc 

r Pcosada^ f P cos udul t 

IJ j U -IF- J = T- 


Let Al = i : 


cosxdx 


-/!• 
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Riemann has given the following ingenious determination of the 
±-sign. Write 

oc (ti+l)?! 

/=!/ 


and in the integral 


r cosx 

V X 


dx 


make a change of variable : 


a: = tt + 


If, now, we set 


F(a) - ^ 


■^/ a i/ a 4* i/" a -h 2 : 


we shall have : 


09 vv 

^ dx = ^ F{(t)cx)s ad CL, 
provided the series cam be integrated term by term. Now 

2C 

2 n 

/=/-/ 


0 0 s 

2 


In the last integral change the variable of integration to y — a. 
Thus we find ; 


f F(a) cos CL dcL = J [W — F{t — a) ] cos a da. 


Now, 




1 r 1 


^ (■/* + *■)* 


] 


and so F* {a) < 0. Hence 
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and, since F(a) — F(t — a) = 0 when a = ir/2, we have : 

0 < F(a) — F(ir — oc)^ 0 < a. ~ . 

Consequently the upper sign is to be chosen. 

It is left to the student as an exercise to justify the integration 
and the differentiation of the series term by term. 

Examvle 4. I^t 


Then 


f{x) = a:*, 0<j:, 0<A<1; 

f{-x) = -f{x). 


ao oo 

sinoixdoi ^ t ^ sin 0.1 dt. 


Set u ^ at. Then 




If X 1, 


Let ^ i : 


cc oo 

= ~ ^ ^ ^ 

^0 0 

oo oo 

/ sin a da F sin udu _ t 

J ^ ’ 

0 u 

C<' 

/ sinac?a 
_ = 


§6. Fourier’s Integral for Functions of Several Vari- 
ables. Let be continuous, togetlier with its derivatives of 

the first order, throughout the whole plane, and let the integrals 

oo c» 

J J* \f{x,y)\dx 

— OO «.oo 

converge. Then from § 4 we have : 
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OO oo 

/(^.r)=~^ do^ J f{i,y)<xsa.{i - x)dl, 
0 

oo oo 

/(£.r) = 7 Jd^J /(£.i) cos ^ (i) — y) dri. 


fix,y) ■■ 


cr* oo oo oo 


da. J* di J* d^J* fii, *)) cos a (£ — a:) cos P (»} — r) rftj, 

0 — oo 0 ~oc 

with a similar formula, in which the integrations with respect to 
a, £ and ij are interchanged. In either of these forms, certain 
discontinuities of the function and its derivatives along reg- 

ular curves can be admitted. But the more important form of the 
Fourier’s Integral is the following : 

3) /Ur) = 

30 OO OC oo 

, ij) COS a ($ — x) cos p (fj — y) r/fj. 


0 0 — oo — oo 


This form can be obtained in the above restricted case of excep- 
tionless continuity, provided the further requirements are laid 
down : — 

The integrals 

OO 30 

4) J lf(x,y)ldy, J* \fx{x,y)\dy 

OO —30 

shall converge uniformly in any finite interval, fl' = x = a!^. And 
similarly, 

oo eo 

5) J \f{x,y)\ dx, J* \fy {x, y) [ dx 

— OO ■ “ oo 

shall converge uniformly, ^ y Finally, one of the in- 

tegrals : 
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oo oo CO oo 

/ ‘^yj* l/(•^> y)\dx 


— oo — oo 


-oo — CO 


shall converge ; then the other does, also. 

The proof is as follows. It is sufficient to consider the integral 


oo oo CO 


7) 

Let 

8 ) 


fdijduf/ii.,) cos cos firj drj. 


^) ~ J n) cos cos pi; drj. 
0 

Then we wish to show that 

9) 


oo oo 


=f^^J 


0 0 
First of all, observe that 

10) 

0 0 

For, the integral : 


4 oo oo 

J dij =Jd^J FU,^)di. 


where 

11) 


oo oo oo 

J FU,p)d^ J* yj/-(i), i) cos Pij d>), 


t (l. V =fU,v) cos “■i- 


converges uniformly in any bounded region, 0 = £ ^ ; cf. 

§2, Exercise, p. 331. And F(i,fi) is continuous, 0 g $, 0 ^ 
because of 4). 

Write 

12) 'lf(£,0)=J’F($,(5)dS, 


The integral: 


oo 

J* F{i,^)di 
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converges, since 


oo 


This last integral defines a continuous function of 4 by 4), and 


oo oo 


converges by 6). We can now write: 


oo 

p)=J* m.fi)d£. 


From 10) we have: 


Z oo oo 

fdij F(i,p)d0 = J 


and from 13) : 


fd&J F{i,fi)di = J 


I oo 


0 u 0 0 

oo 

= I dfi. 

0 

We wish to show that this last integral approaches 0 as £ = oo. 
Consider the function: 

oo 

15) f(«j) = , fj) cos 

the lower limit of integration being merely a constant. The function 
^ (ij) is continuous and has a continuous derivative. For, the integral: 

oo 

16) J* |/„(€.i)U£ 
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converges uniformly by hypothesis, 0 g ^ c. Moreover, the func- 
tion /»,(£, ij) cos a £ is continuous. Hence the integral 15) can be 
differentiated by I^eibniz’s Rule. 

Thus is seen to satisfy all the conditions of the Lemma 

of §2, and so 

oo oo 

17) J* J* ~ 

0 0 


Now, 


oo oo 

^{co, = r Fii,^)di = J\i,i)cos^T,df,, 


V 

as follows at once from 4), 5) and 6). Hence 





CO 

¥ 


f{i,0+)cosa.ldg. 


Finally, 


I J/(|, 0 +)cosa$d£ I g J l/( 4 , 0 +)l«f$, 


and so approaches 0 as S = oo. 

This completes the proof. We have used the hypotheses 5) 
and 4i), but not 42 ). The latter are needed when the integrations 
with respect to ot, 5 and p, f] aire interchanged. 


The Case n ^ 3. The proof for the general case w given by 
a repeated application of the results above obtained. G)nsider the 
case n = 3. Here, 


00 00 00 00 00 00 

18 ) /( 0 + 0 + 0 +) = ^J* do. J* di dy 


cos 0-5 cos cos ^C- 

The last two integrals, beginning on the right, can be replaced by 
f /(£, 0"^). Hence the integrals with respect to { and ^ can be 

interchanged, provided the integrals 
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19 ) J* \f{x,x,z)\dx, ^ \f{x,y,z)\dx, J* \fy{x, y,z)\dx 

— OO — oo — oo 

converge uniformly, each in an arbitrary bounded interval, z being 
merely any constant; and one of the integrals: 


20) 


oo oo 

J dx s \f (x, y, z) I dy, 

— oc — oo 


oo oo 

S S ' ^ 

— oo — oo 


converges. 

We are thus led to the integral: 

oo oo oo oo 

dy J 

0 0 0 0 

Consider first the interchange of the integrations with respect to rj 
and y. Here, the integrals 

oo oo oo 

J* l/(x,y,z) Idz, J* \f{x,y,z)\dy, J* \fzix, y, z) \ dy 

— oo — oo — oo 

must converge uniformly in any finite interval, x being merely any 
constant, and one of the integrals 

oo oo oo oo 

\J' I \ 

— oo — oo — oo — oo 


/(£,»?, 0 cosa£ cns firj cos yC dC> 



X being any constant, must converge. 
So now we come to the integral : 


oo oo 


22) j dl J dy J'd^ //(£. f}y 4) cosai cos firj cos yC dC> 


0 0 ,0 0 
This integral will ha/e the value 


23) 

where 


oo oo oo 

U, C) cos cos yC dCt 

0 % 0 

oo 

f(4, 4'^= ^/(l. •!. C)cosfitid>i, 
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provided the order of the integrations with respect to ij and 4 in 22) 
can be reversed. This will be possible if one of the integrals: 


OO CO 


Jdy f \dz, S dz S \f{x,y,z) \dy 


00 —CO 


We wish to reverse the order of the integrations with respect 
to S and y in 25). Let 

oo 

g z) —J* 1/ (x, y, £) I dy, 

— OO 

00 

h{x,z) =J* I /j (x, y, z) I dy. 

— CO 

We need here to require the uniform convergence of the integrals: 

oo oo oo 

j* g{x,z)dz, J g{x,z)dx, J* h{x,z)dx, 

^oo — oo — oo 

and the convergence of one of the integrals : 

oo oo oo 00 

^ dx ^ g{x,z)dz^ S ^ 

— 30 —CO —OO —OO 

Thus we arrive finally at the integral: 


oo oo 


24) ^ f (^> 0 cos yC 

0 0 u 

Since an interchange of order in the integrations with respect to rj 
and C is allowable, we obtain as the final result: 


00 oo 


25) f{x,y,z) = ^^J da. di 

0 0 0 *”00 

COS a(S — x) cos P («| — jy) cos y ( t ■” -) 



Chapter XII 

Differential Equations. Existence Theorem:. 

§1. The Problem. Consider the simplest case, 

1 ) 

I.ret f [x,y) be continuous in a region 5 of the (.r, 7 )-plane, the 
boundary points not being considered as belonging to the region. To 
each ix)int {x,y) of 5 shall be assigned a direction, the slope of the 
line being defined as the value 
of f[x^y). It is convenient 
to visualize these directions by y 

means of short vectors drawn 
from the points. Thus vve have 
spread out before us a two- 
dimensional family of tliese little 
vectors. 

By a solution of the dif- 
ferential equation 1) is meant 

any function 

2) y = 9 U) 

such that the point [x,y) lies in 5 and the equation obtained by 
substituting the function 2) in 1) is identically true: 

5) [x, 9 {x)\ 

Thus if (:r) must have a derivative, and from 5) this derivative must 
be continuous. 

The graph of the solution 2) is a curve which courses 5. At 
each one of its points it is tangent to the little vector pertaining to 
this point. 

The question now arises, is there such a curve through each point 
of S, and is there more than one such curve? The answer to each 
question turns out to be affirmative. This gives us half of what we 
want — a solution throjpgh each point. The other half is just what 
we do not want — more than one solution. 
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For example, consider the differential equation : 

4 ) 

The function 


dy - i 


5) y = 9 «•) = (^ — a)® 

is seen to be a solution; but it is not the only solution, for 


6 ) 


y ip {x) = 0 


is also a solution; but the functions 5) and 6) do not exhaust the 
possibilities ; for, through an arbitrary point of the plane there passes, 
not one, but an infinite number of solutions. Take the point (1, 1), 
say. Through this point parses the solution 

y = 0 ^ ; 

but for X < 0 there is an arbitrary stretch^ of the x - axis. 


y = Oj ot < X < 0, 
where a is any negative constant. And then, finally, 
jy = (x — a)^, X ^ a. 

A similar situation exists for every point of the plane ; and yet 
the function f {x^y) = 3ri is continuous without restriction, 5 being 
here the «itire plane. 

We can forestall the occurrance of multiple solutions by impos- 
ing a further restriction on f{xy y). It is sufficient to demand that 
f possess a derivative with respect to jy, 


IL. 

dy 




and require that it be continuous** in S. 

All that hais been said can be extended at once to the general 
case of n simultaneous differential equations of the first order in n 


* In particular, this stretch can extend to — oo, or be replaced by a point. 
a«0. 

** This condition can be lightened; it is enough that /j/- be bounded. On 
the other hand, still lighter conditions can be imposed (the so-called Lipschitz 
conditions). But in practice the condition of the text is fulfilled, if sucli a 
condition in any form it present, and so we choose the simpler requirement. 
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dep«ident variables ; cf. § 3. Thus when n = 2 we have: 

7 ) *)• ^ - ^ 

dx dx 

the functions jF, $ being continuous in a three-dimensional region V 
of space, which shall not include any of its boundary points. To 
each point of F, shall be assigned a direction whose direction com- 
ponents (1, jF, $) are suggested by writing 7) in the form: 

Qx dx dy __ dz 

Thus we have before us a three-parameter family of little vectors. 
And now a solution of 7) will be given by two equations: 


9) y=fix), z = f{x). 

Geometrically, these equations represent a curve in space, coursing F, 
and such that, at each of its points, it is tangent to the little vector 
pertaining to this point. 


§2, The Existence Theorem. Theorem. 
differential equation 


1 ) 




Consider the 


where f{x,y) is continuous in an open region S of the {x^yY 
plane, and has a continuous derivative. 

Let ^o) arbitrary point of S. Then there exists a function, 

2) y — 9 W. 

having the following properties : 

i) if {x) has a continuous derivative in the neighborhood of the 
point x =• Xq and takes on the value y^ there : 

yo = <pi^o)i 


ii) q> (x) satisfies the differential equation 1) throughout the 
neighborhood : 

iii) The function (p{x) is unique. 
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The proof is given by the Method of Successive Approximations. 

X 

yi =J* f ^ 

a 

X 

72 =J* f{x,yi)dx + b. 


fi^’yn-i)dx + b, 

a 

where a — Xq, b = j'q. Let 

R-. \x — a\ ^ A, \y — b\ ^ B 

be a region lying in and let 

5) l/(^.r)l = l/r(^.,r)l= G. 

Then 

X 

\yi — b\ ^ J* \fix,b)\dx^ M {x — a) 

if = X, and in any case, 

6 ) \yi — b\ ^ M\ X — a\. 

Now, if yi is to be available in the integral which defines 

the point {x,yi) must lie in S. This will surely be the case if we 

restrict x to the interval 

7) a — h X <C. a k, 0 h ^ Ay 



choosing h so that 

8) Mh g B. 


Form the functions: 


4) 
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Proceeding to r 2 » we see in the same manner that 

r 


Vll 

.<1 

1 

l/(-’^.7i) 1 

^ M\x — a) 

when a = x <. a -f A, and generally: 


1^2-*! ^ M\ 

And so on: 

.r — 1 , 

\x — a\ < h. 

Vll 

1 

1 X - a 1 , 

\x — a \ < h. 


9) b — 

Tims all of the functions jn aie defined in the interval 7), the 
point (:r, j'ti) lying in 5. These shall be called by courtesy the suc- 
cessive approximAtlons, and we will now show that they deserve 
their naine. For, the function yn approaches a limit as n becomes 
infinite. To prove this, let us write 

10) Jn = i + (ri - Jo) + (72 - 7l) + • • • + (7n - 7n-l) 
iuid test the infinite series : 

11) ^ + (ji -7o) + (72 - 7i) + •• • 

for convergence. We have : 

X 

7n - 7n-l ~ J -I'”-') “ f 

a 

Now, 

f yn—l) f — (yn—l Xn~~2)fy (^» Y), 

where Y lies between jKn-i smd ^n-2- Hence (x, T) is a point of jR, 
and 

13) l/^(.r,r)l ^ G. 

We see, then, that 

X 

14) I 7n - 7n-l 1 = j ~ I 

a 

wdien a ^ X <. a and a similar relation holds when x is less 

than a. 
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Begin with n = 2. With the aid of 6) we have : 

X 

\y 2 -yi \ s mg J (x - a) dx = 

a 

when a X <. a and generally: 

15) I.r 2 -ril g \x-a\<h. 

Repeat the reasoning for ti = 3; and so on. We arrive at the 
result: 

16) \yn — yn~i 1 = M G''-^ ^ ^ , \x — a \ < h. 

From 16) it follows that 

17) \yn- yn-l\ ^ MG’<~^-. 

n\ 

The right-hand side of this last inequality: 

18) Mn = MG'^-^^, 

n\ 

is the general term of a convergent series, and hence the series 11) 
converges. But we can infer more than this. The quantity Mn is 
independent of x. Hence the series 11) converges uniformly in the 
interval [ :r — ^ 1 <C /z, and since the ter/ ns of the series are 
continuous functions, the limiting function : 

19) w (x) lim = £> + ( yi — jKo) + ( y-i - yi) + ■ ' • 

7Js=:00 

is continuous in this region. 

Does ^ {x) have a derivative, and if so, does it have the value 
ff{x) =f[x,(p{x)] ? 

The first question is answered in the affirmative by the general theorem 
for differentiating a series term-by-term. Chap. V, § 9, for all the 
conditions of that theorem are fulfilled. In particular. 


20 ) 


(rn - yn-i) =/U,rn-i) -/U.r»-2) 
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g MG"- 


(n- 1)1* 


Thus the term-by-term derivative series converges uniformly, and its 
terms are continuous functions of x. 

It appears, then, that each of the double limits : 




converges, and that they are equal to (x), for this is. precisely what 
the differentiability of the series term-by-term means. Hence, in 
particular 

<p' (j;) = lim/(jr, j„_i) =/[x,^ix) ], 

the last equation following from the fact thaxf{x,y) is continuous 
in the point x = x', y =: <p (;r'), and converges. Thus the 

answer to the second question is justified, too. 

Uniqueness. It still remains to prove that the solution w’e have 
found by the foregoing method is the only solutirn. I^t 

21) u = ip (x), 
and let 

22) (x) 

be any second solution. Then the two functions are identical in the 
whole interval (a, a h) : 

23) ^ (x) — ^ (x) = 0, 0 ^ X — < A, 

or 

U^O. 

If this were not the case, there would be a point £ : 
a ^ i < a + hy 

such that U ^0 when ^ x = but for any interval 


i<x<t<a + hy 
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however short, there will be points for which U ^ 0. 

Plot the curve 

y = \u\. 

I^t $ <, Xi <. 4 be a point for which the corresponding value Ui 
of U does not vanish: 


0 < \u,\. 

Consider the roots of the equation 

1 C7 I = I C/i I 

which lie in the above interval. There must be a smallest root, Chap. 
Ill, § 8, Ex. 6. Denote it by ij = £ H- y. Then 

1 u\ < I r/j. t ^ x< fi- 

Now, 


Hence 


du dlJ 
dx dx 


= f(x. It + Ljy 


^ =f{x, u + U) - f{x, u) = uf,. {x, D, 

where Y lies between u and iz -h U. 

Integrating, we have: 

U,=J Ufy{x,Y)dx, 

I I g 1 1 Cry, 


1 ^ Gy. 

Rut G > 0, and y can be chosen arbitrarily small. From this con- 
tradiction follows the truth of the theorem. 

Similar reasoning applies to the interval {a — A, zr) ; or this case 
can be referred to the one just treated by a transformation, r' = — x. 
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Exercises 


1. The solution 2) of the differential equation 1) is a function 
not only of x but also of (xq^^q). Holding Xq = a fast and letting 
Xii = b va^}^ show that the solution, 

y =■ {f (x, b), 

is a continuous function of the two independent variables (jt, b). 

2. IjdX f{x^y,ai^) be continuous, together with fy[x,y,Oi), in 

the neighborhood of a point (:ro, ®'o)* Show that the solution of 

the differential equation » 

g=/(x,y,a). 

which passes through the point • 

y=zip{x, a). 


is a continuous functions of (x, a) in the neighborhood of the point 
®'o)* 

Hold To fast, but let y^^^b he di continuous function of a. 

3. If to the hypotheses of Question 2 ure added the existence 
and continuity of tlie derivatives* 


?ll = f 

Syi 


yy> 


y-f -f 


and also of Z? = Z? (a), show that the function <p{x, cl) admits a dt'riva- 
tive with respect to a, continuous in the neighborhood of (tq, ao), and 
that the same is true of the function (t, a). 


4. Given the differential equation 


= xe^ —■ ye ^ + sin t -h log ( 1 + y-). 
dx 

Show that it has a unique solution passing through im arbitrary point 
of the plane: 

y — ^. (t; To,7o)» - CO < t < CO, 

and that the corresponding curves sweep out the entire (t, jy)-plane 
just once. 

* Cotton has given a more general theorem, the derivatives of the second 
order not being required to exist; cf. § 4 and Goursat, Cowr$ d'anaLyse matfut- 
matiqiu^ vol. Ill (ISIS') § 460. 
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§3. Continuation; n Equations. Thkorem. Consider the 
simultaneous system of diffei'ential equations: 

1) =f^{x, y^, ■ ■ ■ , yn), A = 1, 

where • ••, Yn) is continuous^ together with its derivatives 

of the first order with respect to yi^ * • in the neighborhood of 

a point [a, hi, • ' • , bn). Then there exist n functions: 

2) yi == V'l U). • • • . yn = 9n{x) 

having the following properties : 

i) ifj^ (j:) has a continuous derivative in the neighborhood of the 
point X = and 

= h; 

ii) These functions satisfy the given system of differential 
equations : 

^'kix)^fk[x,<pi{x), k-l, •••,«; 

iii) The functions 2) are unique. 

The proof given in § 2 for the case n = 1 is applicable in sub- 
stance, the requisite extensions being adequately indicated in the case 
n = 2, to which we now turn. Let us write the system 1) in the 
form : 

3) ^ = F (ar, y, z), ^ ® 

the functions being continuous, together with their first derivatives 
with respect to y, z, in the region 


R : 1 x— a\ ^ A, \ y ^ b\ ^ B, jz— -cl^C. 

Moreover, let 

r 1 F{x,y,z)\ ^ M, l$(a:,7,2)l g M; 

4) j 

^ ^ (x, •••, \iz{x,y,z)\ g G. 

Form the approximations ; 
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5) 


^ X .r 

ri = / F {x, b, c) dx b, -Zi = ^ ^ {x, b, r) dx + C; 

a a 

X 

J* ^ y"-i’ 

a 

X 

Zn = J* 9 (x, Xn-U Zn-l) dx + C, 


restricting j: to an interval 


6 ) h <. X <. hy ^ h ^ 

where h is so chosen that 

7) Mh S B, Mh g C. 

To examine the limits : lim y„ and lim Zn, write 


Xn = l> + ixi- Jo) + ( J2 - Jl) + • • • + ( Jn - Jn-l). 

Z„ = C + {Zi — Zo) + {Z2 — Zi) + h (Zn — Z„_i), 

where yo^ b, Zq = c, and study the infinite series : 

8) * + (jl - Joj + (j 2 - Jl) +•••• 

9) c + (zj — Zo) +• (Z 2 — Zi) + • • • . 

We have from 5) the appraisals: 

10) 1 Jl — I = iV 1 * — « I. \zi — c\ ^ M\x — a\. 


Furthermore, 

X 

Jn — Jn-l \ Fix, J«-i, Z„_i) — Fix, J „_ 2 , Z;,- 2 ) j dx, 

a 

By the Law of the Mean: 

F F {x^ yji^f Zfim^ — 
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(^n— 1 jrn— 2 ) Z) + (-Zn— 1 •2^n-2) Z). 

By virtue of 4): 

11) \ F{x, 7„-i, — F {x, J„-2, ^/7-2) 1 

^ > 1 r»-l -* 7/1-2 I + I ^n-1 - 2n~2 I ! • 

Hence 

z 

12) \yn — Xn-l 1 ^ j* — r >»-2 I + I —Z „-2 1 I dx-, 

a 

and similarly: 

X 

13) I «n — Zn-l I ^ J* G j i 7«-l — yn -2 I + I Zn-i — 2 n -2 I i dx, 

a 

where a ^ x < a k, with a similar relation if a — k <. x < a. 

For n = 1, these appraisals are replaced by 10). When n = 2 
they yield with the aid of 10): 

14) Ijo-yil g 2 MG Izo.-zJ g2MGk^. 

And now it is shown by mathematical induction that, generally, 

r Irn-rn-l I ^ M(2 

15) \ 

[\Z„- z„-i I ^ M (2 G)"-‘ . 1 ^ I - . 

rtl 

where x lies in 6). In particular, then : 

16) ! Jn - y n-l I S I Z„ - Zr.-i \ ^ M„, 

where 

Mn = M{2GY-^^ 




converges. Hence the series 8) and 9) converge. Moreover, their 
terms are continuous and the series converge uniformly. By Chap. 
V, § 4 they define functions; 
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( f (x) = b + (yi - Jo) + ( J 2 — Ji) + • • -t 

17) \ 

(x) = C + (Zi — ^«) + (Z2 — Zl) + • • •, 

continuous in the interval 6) and such that 


\f{x)-b\ ^ B, 
These are the limits sought : 


1 (x) — c I ^ C. 


18) lim Xn = <p W, lim z„ = f (x). 

>1=00 7n=aOO 

Jt remains to show that these functions have derivatives and satisfy 
the given system of differential equations 3). 

The series 8) and 9) can be differentiated term-by-term. For 

4 - (jn ~ J«-l) = F(x, J„_i,Z„_i) — F(x, J„_2,Zn-2). 

dx 

From 11) and 16) it follows that 

^(/n- Jn-l) I ^ 2GMn-x. 

Hence all the hypotheses of the theorem of Chap. V, § 9 are fulfilled, 
and so <r {x) admits a derivative: 

f' — \ F (x, J„_1, z„-i) — F (x, J„_2, z„_2) ! 


= lim F (x, J„, z„) = F [ X, ^ (x), x|r (x) ]. 


Similarly, 

f ' (x) = $ [ X, ^ (x), \|r (x) ]. 

Thus a solution, 

19) y = 9 (*). z = \|r (x) 

of the given system of differential equations 3) is obtained. 
It remains to prove the uniqueness. Let 

u = tp (x), v = ^ (x), 

and let 

M ^ (a:), V + F = ^ {x) 
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be any second solution. Then 

= F{x,u + U,v+ F)-Fix,u,v) 


= U Fr{x,Y,Z) ■¥ F F.{x,Y,Z), 


and similarly: 

(x, Y, Z) + {x, Y, Z). 

ax 

We wish to show that V vanish identically. If they do not, 
suppose that 

«(x) = |C7l + |r|=0, + 

»(^i) ^ 0, { < xi. 


where Xi can be chosen arbitrarily near to Let ij = 5 + y be the 
smallest root of the equation 

GD (x) ~ CO (Xj). 


Let 

U{^) = u„ r(,) = Fx. 

Then 

Ui = I* \ UFy + FFz\dx, 


I C^il ^ + l^il !v. 

and similarly, 

l^il ^ 

Hence 

liuj + ll'il} g 2Gilf/,H-|r,|!y. 
or 

1 ^ 2Gy. 

Since y can be made arbitrarily small, the proof of uniqueness is 
complete. 
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Exercisks 


1. Show that, under the hypotheses of the Theorem, when 
n = 2, there exists a sub-region 

R': \x-a\^A', \z-c\^C', 

and a positive constant such that, if (xq, y-Q, Zq) is an arbitrary 
point of there is one and only one solution of the differential 
equations 3): 

r = ; ^0. ro. ^o). Z = <p{x; Xo, yo> Zo). 

defined throughout the interval 

— V < X — :ro < A', 

with / (xo; Xq, yo, Zq) = yo and ^ (xq; Xq, yo^ Zq) = Zq. 

Generalize to the case n n, 

2. Carry through the detailed proof in the general case, n = n, 

3. Extend the Exercises of § 2 to the general case of this par- 
agraph. 

4. Let the function fk{^,yiy***,yn) of the system of dif- 
ferential equations 1) be continuous when x lies in the interval 

a ^ x ^ h 

and yu ' ' ' ^ y-n unrestricted, and let the first derivatives of fk with 
respect to the y^ be bounded. Show that through an arbitrary point 
passes one and only one solution 2), defined for the 

whole interval (^x, 


1 ) 


§4. The Semi-Linear Case. Let the simultaneous system:* 

% =/(*.r) 


dz 

dx 


= z ^ {x,y) 4- vj/ {x,y) 


be giyen, where f {x^ y), if (x, y), yjr (x, y) are continuous in the 
neighborhood of a point (a, b), and where, moreover. 




• cf. foot-note, p. 556. 
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exists and is also continuous there. The first equation admits a unique 
solution, 

2) Y=tp (x), tp (a) = b, 

in the neighborhood of the point x = a. 


3) 


a — h<x<.a^h. 


When this function is substituted for y in the second equation, the 
value of h being conceivably cut down, so as to bring the point 
(x, Y) within the above neighborhood, the latter becomes a linear 
differential equation in 'z, and it ad nits, for an arbitrary initial 
value, z •*= c, a unique solution Z, defined throughout the whole in- 
terval 3). Thus 


4) 


dY 

dx 


=/U, r\ 


g- = Z<.(x,r)+t(x, F). 


So far, then, as the solution of the simultaneous system of dif- 
ferential equations 1) is concerned, there is nothing left to be desired. 
By means of the resulting functions, which satisfy Equations 4), we 
proceed to develop a 


CoNVERGBNCB THEOREM. Let a sequence of successive approx- 
imations be defined as in §§ 2, 3 : 


5) 


X 

y^—f f{x,yn-i)dx + b, 

a 

X 

^-1 *P F«-i) + F»-i) ]dx ■>rc. 


with = b and Zo — y> y is arbitrary. Then 

]im y„= ¥ (x), lira z„ = Z (x). 

noBOO nr— inn 


Moreover^ yn == yn (^) tmd Zn Zn(x) converge uniformly 
in the interval 3). 
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So far as lim yn is concerned, the proof comes under the earlier 
case. As regards lim Zn, write from 4) : 

X 

Z = \Zip{x,Y) {x, Y)\dx c, 

a 

and fonn the difference: 

6) Z - = 

X 

J* \2.(p{x,Y) — <p {x, y„-i) + (x, y ) — \J^ (x, } dx. 

m 

Set: 

r (x,y„} = tp (x, Y) + 4„, 

^ 'I' (x, yn) = f (x, Y) + 

Since y„ (x) converges uniformly in the interval 3), we have : 

U« I < 1. I in I < 1. m ^ n, 

where ij is an arbitrary positive constant, and m is independent of x. 
Rewrite 6) in the form : 

X 

7) Z - z„ =J { f (x, j„_i) (Z - z„-i) - Z 4„_i - 4'_i i dx. 

a 

Let e be an arbitrary positive number. Th«i ij can be so chosoa 

that 

8) 1 — Z Cn-i — i'n-i 1 < «. m ^ n, 

where x lies in 3) and m is independait of x. Moreover, 
|f(x,:y;_i)l g G, 

where G is a suitable positive constant. Hence 

X 

9) \Z- z„ \ ^ J* \G\Z- Zn_i \ + i\ dx, m^n. 


a ^ X < a + h. 
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Let M be so chosoi that 


G 1 Z — Zm-l \ + t M 


when X is in 3). Then 


\Z-z„ \ < M\x-a\. 


From 9) we now infer that 

By mathematical induction it follows that 


-h € Lr — 


. 0 ) + 

Hence we arrive at the final appraisal: 

11) \Z-z„+r\ ^ M&- 

and the G}nvergence I’heorem is established. 

Both theorem and proof admit an immediate generalization: — 

CoNVERGENXE THEOREM. GENERAL Casb. Let the System of 
simultaneous differential equations be given: 


• • •, Jm), *=1, •••,»!; 


= X "'yym) + • • sym), 

I / = 1 , • • 

where fky *fijy q>j are continuous throughout the neighborhood of a 
point («, ^ 1 , • • ^m), nnd where^ furthermore^ the derivatives 

a = 


exist and are also continuous there. 

Form the successive approximations: 
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/ 


13) 


y'k = J Mx, dx + 

*Q 

=/ ( i 9ii rS"-'’,- • • . r,r‘ ) 

+ (^. , Jm"*') ) + 2®, 


^ m ; 


i,j = J, - • •,/ ; 


1 < n. 


where (xq, j i, • • * , y^m) is an arbitrary point in the neighborhood 
ofiaM ond z® is u>holly unrestricted. 

For n = 1, replace by p*, y,*, (0i, • • •, 

/i€5 in the neighborhood of (i>i, * • s^m), (Vi* ’ * ’» V/) ^ wholly 
unrestricted. Let (cj, • • •, C/) Z>e an arbitrary fixed point. 

Then there is an interval: 

a h < X < a + h, 
and a neighborhood of the point 

Uo.Jlt •• ‘.Jm-Zl. •••.4) = (">*>' • Cl, • ••„Ci) 

within which the functions: 

r ji"’ = Jt ’ : ^ 0 , 7?. • • -.rfn), = 1, • • •. m; 

I = zf) (x ; Xg, 7?, ■ • ,y%„ • • •. 4) y = 1. • • • 

converge uniformly to the solution of Equations 12); 

Yk = Ok U; ^0. 7i. • • • .7^). * = 1, • • • , m; 

y = i, •••,/. 


14) 


r Yk = 5* U; a:#, 7i, • • • ,7^), * = 

< 7.j = usj (a:; Xg, 7?, • • • , 7 ^, z?, • • • , zj), 


Finally, the differential equations themselves may depend on 
parameters. The simplest case. 


15 ) 


g-=/U.7.«-). 


dz 

dx 


= zy (x, 7, a) + {x, y, a.), 
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is illustrative for the general case. Let a), 

^ (^» «») be continuous in the neighhorhood of (a, b, ot'). Let 

exist and be continuous there, also. 


dy 


Convergence Theorem. Let a sequence of successive approx- 
imations be defined by the formulas -. 


16) 


y^—J* f(^^yn-u «■) + ro. 

*0 

X 

^—J* CL)dx-{-Za, 


1 71 , where (:t:o,yof Zq, cl) is an arbitrary point of a certain 

neighborhood of {a, c, a') ; here, c is an arbitrary constant. 
When Tz = 1, the arguments ^n-i shall be replaced by y, 

where lies in the neighborhood of b^ and y is an arbitrary 
constant. Then there is an interval: 


and a neighborhood of the point (:co, ^o» ®') ~ ct'), within 

which the functions 

yn = yn {x\ Xo, Zo, tt), Z„ = Z„ (x; Xq, Jo. ^o- «■) 

converge uniformly for n = oo to the solution of Equations 1 5) 

fY = <p{x-, Xo,yo, Zo, a), 

17) ] 

Z = v|^ (x; Xo, Jo. «o. «■)• 


§5. Dependence on Parameters. 

plest case, 


1) 


-g=/U,j), 


Beginning with the siin- 


we have the solution: 

2 ) 


y = ip {x\ Xo, Jo). 



368 


FUNCTIONS OF REAL VARIABLES 


where ip{x\ is continuous in the neighborhood of {a; a,b)j 

and where 2) holds uniformly for an interval 

3 ) a’-‘h<,x<ia + hj 

k being constant for points (tq, yo) lying in a certain neighborhood of 
the point (^z, b). 

So much can be inferred directly from the proof of existence by 
successive approximations. That process did not throw light, however, 
on the existence of the derivatives 

dip 

By means of the results of § 4 the existence and continuity of these 
derivatives can be established under no additional hypotheses concerning 
y (^» y) beyond those of § 2, Theorem. 

Start with the sequence of successive approximations; 

je 

*0 

Then 

5 ) yn=^fn{x-,Xf^,y^ 

admits continuous first partial dwivatives with respect to Xp, y^. We 
wish to show that the limiting function: 

6) r = lim jKn = 7o + (ri — ro) + (r2 — n) + • • • . 

7Js=30 

admits continuous first partial derivatives with respect to XQ^y^, This 
wiU be the case if the conditions of the Theorwn of Chap. V, § 9 are 
fulfilled. The one outstanding hypothesis is that of unifonn conver- 
gence of the series of derivatives; 


7) 


ill + V ^ iyn - yn-i) 

^^0 dxo 


+ y ^ - rn-i) 


That this hypothesis is in fact fulfilled, can be shown as follows. 

Suppose for the moment that these derivatives do exist, and write 
them : 


8 ) 

Now 
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X 

'= J fi.=c,Y)d 


'x + Jo- 


Hoice 


S) 


Is "/ Is 

■*<) 

•*^0 

From the foregoing reasoning we infer the following: — A neces- 
sary condition for the existence of the ftinction 2) and its partial deriva- 
tives 8) is that these functions satisfy the system of simultaneous 
semi-linear differential equations : 


10 ) 




dz 

dx 

du 

dx 


= zfy{x,y\ 


with the initial conditions: 

11) a: = Xo, r = ro» ^ = -/Uo. Jo)» Wo = 1- 

The form of this result, combined with the developments of § 4, 
suggests a means of establishing the uniform convergence of the 
series 7) and thus completing our proof. By §4 the system 10) can 
be solved by the aid of the successive approximations : 


f 


12 ) 


X 

yn /(*.yn-l) dx + Jo. 

•'o 

^-J *"-l fy (*• yn-l) dx—f (Xq, Jo), 
■^0 

X 

Un-ify {x, Jn-l) dx + i. 
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\ <. n. When « = 1, the (iefiniti 9 n of zj, Ui can be made to 
serve the application we are about to consider. 

Turning to Equation 4) we see that 
f X 

=J ■^J^fy(^,yn-i)dx -f{xo,yo), 

13) ■ “ 

dyQ J dyo 


When n = 1, these equations become: 


14) -|=^ = -/(*o. Jo). ^ = J fyix,yo)dx + 1. 

■^0 

Returning to Equations 12) let us agree that, when n = 1, the 
arguments z„«i, Un^i shall be set equal to yo, 0, 1 respec- 

tively. Then, by virtue of 14) : 

We now subtract Equations 12) from Equations 13): 


-j fy{x, j„_i) [ - z„_i ] dx. 



\ ^0 

1 < n. Hence it appears that identically, for all such values of n: 




and thus the uniform convergence of the series 7) is established. 

The extension of the result to the case that the differential equation 
depends on parameters presents no difficulty, and we are thus led to the 
general theorem: — 
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TiinOBiM. Consider the system of differential equations: 

Ji. • • -.Jn; Xi, • • -.Xm), 

^ = 1, * * •, n, where fk together with the first partial derivatives: 

Hk djj^ 

dyj ’ ’ 

is continuous in the neighborhood of the point (fl, ^/i, 

X X^). Then the solution: 


Jk = tpkix-, y'i, • • ■ , yl\ Xj, •••,Xm), 

where 

y\ - n (^o; yi“- ,yn; Xj, • • , X^), 

is continuous together with ^ZZ n + m + 2 first partial derivatives, 
in the neighborhood of the point {a\ a, b^, ••• ,bn\ * *» ^m)* 

Since 

Xj, •••,Xm), 

it is cleair that each of the derivatives 

d difi^ d d(pjg 

dy^ dx ’ d\^ dx 

exists and is continuous. 


§6. Implicit Integral Relations. The differential equation 
of § 2: 


dy 

dx 


=f{x;,y). 


admits the solution : 

1) J Jo). 

where ip is continuous together with its derivatives of the first order 
in the neighborhood of the point {a, a, b). It might seem, then, that 
we had found in 1) a primitive (~ solution) of the diffei-ential equa- 
tion which depends on two arbitrary constants, Xq and y^. But in 
substance there is only one ; for if we hold x^ fast, we obtain the 
whole family by allowing y^ alone to vary. If, then, we write, as 
in §2, Ex. 1, the solution in the form : 
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2) y — ip{x,b), 

we have what may be called the “general” solution, depending on a 
single arbitrary constant. 

In fact, it is through the present existence theorems that one can 
attach a precise meaning to the term general solution. The for- 
malism of special differential equations, integrated by special devices, 
is a morass of half-true theorems, which are unreliable in any given 
case. Take, for example, the differential equation : 


V 

dx 


The function 


is a solution of the form 

y = ^{x,c)\ 

i.e. containing an arbitrary constant — and that is all that is called 
for in many of the books on elementary differential equations, such 
as are used in a sophomore or junior course. But this solution is not 
general, for there is no value of c which gives the solution 

r = 0. 

On the other hand, the solution 


y = Ce^ 

is general. But how is one to know, from the formalism of ele- 
mentary functions, even now, whether all solutions have been rounded 
up? In this case, the existence theorem of § 2 is unnecessary, as 
the explicit function supplies the demand; but the uniqueness theorem 
is essential, and answers the question with which formalism is power- 
less to deal. 

The example of § 1 ; 

ax 

y = fix, a) = U - a)®, 

is also a case in point. 
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Implicit Form of the Integral. Consider the solution 1) of 
this paragraph. Let be any point on this curve, in a 

suitable neighborhood of (:*:o».Xo)* Then 

n = v’Ui;^o.ro)- 


On the other hand, apply the existence theorem to the given 
differential equation 1 ) of § 2, considered for the neighborhood of 
(jTi, yi). Then the solution is given by the equation : 

y = 

where <p is the same function as before. In particular, this curve 
goes through the point (jco» ^o) because of the theorem of § 3, Ex. 1 
and the uniqueness theorem : 

yo = •p{xo-,xi,yi). 

But (xi, yi) was any point on the curve 1). Hence 

y = ^ix-, xo, yo) and yo = <P (xoi x, y) 

are equivalent equations. 

The result can be extended at once to the general case of § 3. 
Ijet the solution 2) be written in the form ; 

3 ) = *= 1 , 

If j:o = a is held fast and y^ = is regarded as a pauameter, then 

4) yk — A:=l, ---.n, 

is the general solution^ in that it gives every solution which courses 
the neighborhood of the point {xQ^y\y • • The solution depends 

on n arbitrary constants, the • • •^hn- 

On the other hand, the points {xQ^y\^ • • *, and (x,7’i, • * ‘^yn) 
can be interchanged as above, and we have as the equivalent of 3) 
the n implicit equations : 


5 ) 


A - f*(*o; x,yi, • • 


^ = 1, •• '.w. 
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Observe that the Jacobian of these n functions ; 

has the value 1 in the point x = Xq, yk = y\- For, in 3), ipk re- 
duces to y\ when x = Xq, That the derivatives involved exist and 
are continuous, has been shown in § 5. 

A more general definition of an integral of the given system of 
differential equations is the following. Let 

cc (r, Ji, • • NjKw) ^ const. 

be continuous, together with its first derivatives, in the neighborhood 
of the point y\, • • • , constant along a solution 

4): 

•••»?>»] ^ c. 

Then the equation 

aU, ri, • • ^,yn) - c 

is said to be an integral of the system of differential equations. 

If 

* • * » yn\ ^2 % yn) 

are two integrals, they are said to be independent if the matrix 

du5i . 

^yi dyn 

dfjS2 

is of rank 2. — The generalization of the definition to the case of k 
integrals is obvious. 

Exercisfs 

1, Let 

Ck == <£>k{hu * * ^' = 1, • • sn, 

where co;fe (^i, * • • , ^n) is continuous, together with its derivatives of the 
first order, throughout the neighborhood of the point = 

(ji» • • Jacobian 
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^ (^1 >-***< ^w) ^ Q 

^(^1, ^ 

Let 

^P;fcU; hi, •••,hn) = 'I'aU; q, • - .c^), = 1, . . ., n. 

Show that the equations 

yk = ^i(^; Cl, • • •,Cn), ^ = 1, • • 

express the general solution of the given system of differential equations 
1 ), § 3, — in the two-fold sense in which that term has been ex- 

plained. 

State your final result accurately as an independent theore n. 

§7. Linear Differential Equations* Thi:orkm 1. Consider 
the system of linear differential equations of the first order: 

1) + • • • + PnJJn + P*, 

A: = 1 , * • * , n, where Pj^ = Pjk i^) ci^d P^ = Pk (^) cLre continuous 
in a closed interval: 

2) a ^ X ^ b. 

Let bi, ’ * bn be an arbitrary set of numbers, and let Xq be 
an arbitrary point of 2). Then there exists a solution of \): 

3) Xk = <fki^\ A-=l, •••,«, 

where ip^ (:c) is continuous, together with its first derivative, in the 
closed interval 2) and 


= A = 1, •••,/». 

Moreover, the solution is unique. 

The theorem comes under the more general one of § 5, Exercise 
4. By means of this theorem it is possible to treat the linear 
differential equation of the n-th order : 


4) 






d^~'^y 

dx^'^^ 


+ • 




where the coefficients Pk~ Pki^) P ~ P^^) ^ continuous in a 
closed interval 
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For on settins: 


we have: 


a ^ X ^ b, 
d-Yk 


<rn-o _ 
dx ^”-1’ 

= -Plfn-l - -Pny ■\rp. 

We are thus led to the following existence theorem. 

Thi:ohi:m, 2. The linear differential equation of the n-th or dir 
Equation 4), admits a solution defined throuf;hout the interval 5); 

y - 9 (^). a ^ X ^ b, 
such that^ if Cq, Cj, • • - ,Cn^i be any n numbers whatever^ 

9 (^o) = 9^ (^o) = * * • » f (^o) = 

The solution is unique. 


§8. Differential Equations of Hig^her Order; General 
Case. The general differentiiil equation of the w-th order can be 
written in the form: 


1 ) 


- fix Y ••• 


where f{oc,y,yi, • • • , is continuous, together with its first deriva- 
tives with respect to y,yu in the neighborhood of a point 

(^ 0 ^ Ji’ * ' ■» Dn making the substitution 6) of §7, the 

given differential equation 1) is replaced by the system 7) of § 7, except 
that the last equation 7) now becomes; 


dyn^\ 

dx 


— f^^t y^yx't * * ’ » i)* 


2 ) 



DIFFERENTIAL EQUATIONS. EXISTENCE THEOREMS 377 


The existence theorem is precisely similar to Theorem 2, § 7, 
except that the domain of definition of the solution is restricted to 
the neighborhood of the point x = Xq, 

Exercises 


1 . Extend the existence theorem to the most general case. 
Begin with two differential equations : 

=f{x,y,y, ■ • z, z', • • •, z('"“*)), 

ax*' 


d^z 

dx'^ 




2. Apply the result to the system : 

^qk 


dt^ 


+ 7* — 0, 


A= 1, 




where n* is a positive constant. 


§ 9, Complex Variables* Corresponding theorems hold in 
the domain of complex variables, but the proofs are simpler. Be- 
ginning with the simplest case, 

% 

let f{x,y) be a function of the two complex variables x and jy, ana- 
lytic in the point Then there exists a solution, 

analytic in the point x = and taking on the value there : 

yc = V (-^o)- 

Moreover, this solution is unique. 

The proof can be given by the method of successive approxima- 
tions, as before ; but the details are simpler. For when once the 
series 

& + ( ji — yo) + ^ j2 ~ ri) + • • • 

has been shown to .be uniformly convergent throughout a certain 
two-dimensional, or complex^ neighborhood of the point x = Xq, it 
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follows that the series represents an analytic function and can, by a 
general theorem due to Weierstrass, be differentiated term-by-term. 
Moreover, the case that f depends on a parameter, a, the function 
of the three complex vaiiables being analytic in the point 
(xq, is dealt with immediately, without any additional analysis. 

The function <p{x,aL) of the complex variables is analytic in the 
point (xq, ao), and so can be differentiated with respect to a an un- 
limited number of times, the series being differentiable term-by-term. 

The generalization to the case of a simultameous system of n 
differential equations presents no difficulty. 


§10. Linear Partial Differential Equations of the First 
Order. Consider the linear partial differential equation : 




+ x„^ = o, 

OXi dXn 


where X/t = V/t (xj, • • • , x„) is continuous, together with its first 
derivatives, in the neighborhood of a point («|, and not all 

the Xk vanish there. 

Consider, secondly, the simultaneous system of total differential 
equations : 


B) 


dx\ _ __ dXn 

X, 


To solve Equation is equivalent to solving equations J5); and 
conversely. 

The theorem is adequately illustrated in the case n = 3 : 


A>) 




+ Z 


du 

dz 


= 0 ; 


^ X r" z * 

The solution of 5') is givai by the equations : 

1) Zq), Z — ip Xo, Xo, Zq), 

provided X{a,h,c) ^ 0, where lies in the neighborhood 

of Let Xq a he held fast, and interpret {yojZo) as a point 

in the plane x = a, lymg near (y, z) = (^, c). Then the equations 
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2) r =/ (x; a, jo> ^o). z = <p{x; a, jo> ^o) 

represent a two-paranieter family (a so-called congruence) of curves 
coursing the neighborhood of (tf, c). No two of these curves in- 
terse::t,. for then there would be two solutions of B^) through such a 
point. Moreover, through each point of the neighborhood passes a 
curve 2 ). For, the implicit form of 1 ) is 

5) Jo ^ / (^0 ; 9 Uo; ^)* 

Hence 2 ) is equivalent to 

4) zq = <p {a; X, y, z). 

We see, then, that an arbitrary point Zj) near {a;h, c) will lead 

through 4) to a point {yQ, Zq) in the plane x a, near {b, c ) ; and the 
curve 2 ) corres^x)nding to these values of yo, Zq will go through 

Integral Surfaces. Consider the surface: 

5) f{a\ X, y, z) = const. ( = 7 o)- 

It cuts the plane a: = in the line 7 = 7 ' = const. For, 

6 ) /(^o; ^o>7o>^o) = 7o 
is an identity in (xq, 7 oi.^o)- Hence 

f{a\ a,y,z) ^ 7 , 

no matter how (y, z) be chosen near (3, c). Because of 5), y must 
have the value y^x but z is arbitrauy. 

The equation 5): 

/(«; x,7,z) =7o 


can be solved for y\ for 


M 

dy 


= 1. 

Uo, J0.Z0) 


Hence 5) can be represented in the form : 


7 ) 


7 = X (r, 2). 


The surface 5) is an integral surface of the differential equations 
B'), as has already been pointed out in § 6 . In particular, then, the 
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solution of 5') which passes through a point (^i, ri,r) of 5), cuts the 
plane x = a in the line r = yQ. Thus the surface 5) or 7) is swept 
out by the solutions of B') which pass through the points of the line 
y ^ yQ in the plane x — near z = c. 

Similar remarks apply to the surface 

8) (a, X, y, z) = const. (= Zq). 

This surface cuts the plane :i = a in the line z = Zq = const. Equa- 
tion 8) can be solved for z: 

9) 2 = - (x, y). 

This surface is swept out by the solutions of B^) which pass through 
points of the line z = Zq in the plane x = a, near y =h. 

Consider now more generally an arbitrary regular curve of the 
plane z = which passes through (y^ z) = c) : 

10) Q iyo, Zo) = 0, 

where the first derivatives, 0^ and Qo, exist and are continuous near 
c), and not both vanish there. The equation 

11) o(/.f) = o 

represents a surface, swept out by the solutions of .B') which cut the 
plane x a in a point (jyo»^o) the curve 10). For the points that 
lie on these solutions obviously are points of 11); and conversely, a 
point {xi^yi^Zi) of 11) near [a, b, c) determines a pair of values y^^ Zq : 

ro =/(«; z:i, y\, Zx), ZQ = f {a-, Xx,yx, Zx) 

which satisfy 10). 

Solution of the Partial Differential Equation A'), The function 

12 ) u—f{a,Xyy,z) 

is a solution of A'). For, the nonnal to the surface 5) in an arbi- 
trary point is perpendicular to the solution of B') through this point. 
H«ice 
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Similarly, the function 


u = tp{a-, x,y,z) 


is a solution of A') and we have 


14 ) 


+ 7M = Q. 

OX oy oz 


More generally, 

15) u = Q{f,<p) 

is a solution. For 


/ 


dx dx 



^ = 0, + Q.> , 

dy dy " dy 


\ 


d u 
dz 




+ Oo 


d <p 
dz 


On multiplying by X, Y, Z respectively and adding, the result follows 
fro n 15) and 14). 

Finally, let 

16) u = (j:, y^ z) 


be an arbitrary solution of where ^ is continuous together with 
its first partial derivatives in the neighborhood of the point {a^ by c) 
and not all the derivatives vanish there. The surface 


17) 


Slf {Xy yyZ) — '^ (a, by c) 


is tangent at an arbitrary one of its points to the solution of JB') which 
passes thiough tliis point, as is clear from A*), In particular, then, 
the surface is not tangent to the plane x = a. 

Moreover, the solution of B') which goes through a point of 17), 
lies wholly in the surface. For, when y and z are given by 1), 


dx 


= >1^, + ^ 



= 0 . 


It follow's, then, that the surface 1 7) is swept out by the solutions 
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of which pass through the intersection of the surface 17) with 
the plane x ^ a. 

There is still one point to be considered. The surface 17) cuts 
the plane = a in a curve 10), for since this surface is not tangent 
to the plane x ^ a, it follows that not both the derivatives d^/dy 
and d^/dz can vanish. The surface 17), therefore, is swept out by 
those solutions of B') which pass through the points of this curve. 
The converse, however, requires proof, for it is not evident that the 
solutions of B^) which pass through the points of 10) sweep out a 
surface 17). Let 

^ = F[x,y,z\ 

where Q ^o) function 10). Then we will show that Fr. 

Fz are not both 0. We have : 

iT = 0. ^ + 0, 


Now, 


Qj 


1^ + 02 

oz 


dip 

dz 


g(/.y) 

9 iy,z) 


^ 0 , 


and Qi, Q 2 are not both 0. Hence Fy, Fz cannot vanish sirnultane- 
# 

ously, q. e. d. 

The result may be stated in a somewhat more general form as 
follow's. 

Solution of A^) by B'). Let V be a regular curve drawn 
through the point (fl, b, c), not tangent to the solution of B') there. 
The solutions of B') which pass through the points of T sweep 
out a surface, 

20) ^ {.x,y, z) = C, 


wheie ^ is continuous together with its first partial derivatives in 
the neighborhood of {a, b, c), and not all of the latter vanish. The 
function 

21 ) u — '^ix^yyz) 

is a solution of A^), And conversely, any solution 21) of A'), suck 
that satisfies the above conditions of continuity^ is obtainable in 
this manner. 
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Solution of the Total Differential Equations j5')- VVe proceed 
now to solve the system of total differential equations 5') by means 
of the single partial differential equation A^), Let 

22) M (x, y, z\ M = @ (x, y, z) 

be two solutions of A^) such that the rank of the matrix 

dx By Bz 

ao ao a© 

Bx By Bz 

in the point (a, c) is 2. Then the curve 

24) (x, y, z) = a, ® (x, y, z) = 

where (a, P) is a point of the neighborhood of {olq, ^o) * 

{a, b, c) = ctQ, ® {a, b, c) = Po» 

is a solution of For each of the surfaces 24) contains the solution 
of B^) which passes through a point of intersection of these surfaces. — 
We may state the result as follows. 

Solution of B^) by A'). Let ^ (x, y, z) and @ (x, y, z) he 
two solutions of A^) satisfying the conditions that the matrix 23) is 
of rank 2. Then the solutions of B*) are given by the equations 24). 

§ 11. The General Case. It is now easy to state the theorem 
in the general case. Given the linear partial differential equation A) 
of § 10 and the system of n total differential equations J5), let at least 
one Xyfc be different from 0 ; 

(^i» * * *» ^n) ^ 0. 

Through each point (x®) = (x^, • • , xj) of the neighborhood of {a) 
passes one and only one solution of B), represented by the equations 

X? = fi (fli; Xi, • • *, x„), £ = 2, • • •, 7i; 

^ 0 . 
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In particular, there is a one-to-one relation between these solutions 
and the points • • *, jtJ) in which they cut the plane Xi =■ aj. 

Each function 

u = Xi, •••,!„) 


is a solution of A). More generally, let 

0 ix2r • • \Xn) 


be continuous, together with its first derivatives, at least one of 
which shall not vanish in { 02 , • * * , an), and let 

n (a2, • * S tfn) = 0. 


Then the function 


u = Q i<p2, * • • , f ») 


is also a solution of A). It is, moreover, the most general solution. 


u = (xi, --^Xn), 

which has the property that at least one first derivative (here, 
du/dxi) does not vanish. Thus A) is completely solved by B). 
Conversely, B) is completely solved by n — 1 solutions of A) : 

14 = (xj, • • Xn), * • *, 1 (^1» ’ ’ •» ^n)» 

considered in the neighborhood of the point (x) = (a), provided that 
the ranJt of the matrix 



.. 

dxi 

dx„ 

^'*>-1 ... 
dxi 

... 

dxn 


in the point {a) is /i — 1 . The /i — 1 equations : 


(^l» * * *» ^ft) 


i = 2, 


determine the solutions of B), 
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§12. Chancre of Variables. Let 


1) 




k= 


where (xi, • * • , Xn) has continuous first derivatives in the neigh- 
borhood of the point (x) = (a) and 


2) 


d(xi. 


0 


in (x) = (a). Then A) and B) go over into 


Zi 


du 

dyi 


+ 


d" Zn 


du 

^yn 


= 0 . 


Let 


dy\ - ... _ 

Zi "■ Z„ • 


= P Zi, 


A- = 1, • • •,«, 


where /> is any non-vanishing function of (xj, continuous 

together with its first derivatives near (a). Then the solutions of A) 
and B) will go over into the solutions of 


Yx 



-I- F» 


du 

^yn 



dyi ^ ... - dyn 
Yx ' Y„ • 

It appears, then, that the equations A) and B) are invariant of 
a transformation 1). We can use this fact to reduce them to a 
simpler system, in case one or more integrals are known. Suppose 
that m < n independent integrals are known. 


’l'l(xi, • ••,X„), •••, ^ct(xi, 

where the matrix 



d<lf^ 

dxi 

dx„ 


... ^ 

dxi 

dxr. 


3 ) 
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is of rank m in the point Make a change of variables, 

setting (in case the determinant corresponding to the first m columns 
of the matrix is ^ 0) 

4) yk = (^i» • • *, ^n), A = 1, • • •, m, 

with the further ^’s any functions such that 2) is satisfied. The 
transformed equations admit the integrals 


yu • * 


and hence 


r, = 0, •••, 

The transformed system thus takes the form, if m < n — • 1; 


V JL. 

J-m+i -r 


5) 


dyi 


+ y„4^ = o. 


m+i 


^yn 


dym+l ^ ~ 

Tm+i Yn ' 


These equations can be solved by setting 


6) yk — Ck, A: = 1 , • • • , m, 

where the Ck are suitably restricted arbitrary constants, and then 
considering the new system. We have thus been led to a system of 
equations like the original system, the number of variables, however, 
having been reduced from n to — m. 

Transforming back to the original equations in the x’s, i.e. to 
Equations A) and jB), we see that Xi, • • • , Xjn can be determined 
from the equations 

7) (^1, • * ' , ^n) ~ Cj, • • • , m (^1. ' * ' » ^n) 


Thus the equations 

8) 


dXm+\ 

Ym+\ 



yield, on replacing Xi, • • •^Xm in the X’s by their values from 7), a 
system in which only n m variables, JTm+il ' * * » appear. 

The justification for the elimination in both cases lies in the 
theorem of uniqueness. One solution of Equations 5) is given by 6) 
and the n m further ^nations. But there is only one solution. 
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One question, however, still remains open. We started with the 
hypothesis that at least one of the X’s did not vanish in the point 
(/Zj, Are we sure that there will be a T which will not 

vanish? Otherwise we could not apply the existence theorem to 
Equations 5). From 4) we have: 

^Xk = + • * * -f CnkdXny Al = 1, • • w, 

where the determinant of these equations is the Jacobian 2). From 

d-x-^ ___ dXfi 

follows that each of these ratios has the value: 


C\kdx\ -h • * * 4* CfikdXfx 
Cik Aid" * * * + Cnk An 

Hence these denominators cannot all vanish, and so, in particular, at 
least one of the Fm+i, * * *• Yn must be different from 0. 

§13. The General Partial Differential Equation of the 
First Order; n = 2. Consider the partial differential equation 


1) 

vvViere 

2 ) 


F (r, y, z, p, q) = 0, 




dz 

dy 


Here, F (x, y, r, /?, </), together with its partial derivatives of the 
first two orders, shall be continuous in a region of the space of the 
{x, y,z,p,q\ where {x,y^z) is any point of a region R which 
includes none of its lx)undary points, and p, q are wholly unrestricted*. 
Finally, dF/dp and dF/dq shall not vanish simult .ously. 

What does the differential equation 1) mean geometrically? We 
seek an answer analogous to that given in § 1 for ordinary differential 
equations. 

I^t (oTo, > o» ^o) ^ point of R, and let 


3) 


2 = ^ (:r, y) 


• More generally, we may impose the requirement for the neighborhood 
of a point (a, h, c, «, 3). The treatment is essentially the same. 
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be a solution of 1), the surface S represented by 3) passing through 
(•^o* ^o) It is assumed that $ Cr, jy), together with its first 

derivatives, is continuous in the neighborhood of (xq, Xq). The direc- 
tion components of the normal to 5 are {po, 9o» 1)» where 

Po = (^0. Vo), go = Uo. ^o)- 

Th(‘y are subject to the condition : 

4) FUo^ ro, Zo. Po^ 9o) = 0. 

This fact gives us the clue to the geometric interpretation of 1) 
which we are looking for. Let (x^ y, z) be an arbitrary point of H, 
and hold it fast. Then 1) defines a one-parameter family of lines 
through (xj y, z), namely, those whose direction- components are 
(p^g, — 1) ; and these lines generate a cone, iV, — the cone of normals 
to the solutions of 1) which pass through (x, y, z). 

The planes through (x, y^ z) normal to these lines envelop* a 
cone T. These planes are the tangent planes to the solutions of 1) 
which pass through (x, y^ z), and each generator of the cone lies in 
one of these planes. We thus have, assigned to each point of R, a 
cone r, and any solution of 1) defines a surface S in R which is 
tangent at each of its points to the cone corresponding to this point. 

This is hardly enough, however, to enable us to determine the 
integral surfaces 5 of 1). But we can go a step further. Turn 
back to the point (xq, Xq, Zq) and consider the tangent planes per- 
taining to this point. They are given by the equation 

5 ) z- zo = p{x- xo) + giy- Xoh 

where p, q are parameters connected by the equation; 

6) F(xo,:ro. zo.;'. 7) = 0- 

Their envelope is determined by 5) and the further equation : 

7) 0 = (a: — xo) + (jr — Jo). 

dg 

in case dF/dp ^ 0, the condition mentioned in the foot-note being 
fulfilled. Introduce the notation: 

• A further condition of inequality here is needed; cf. the Author's 
Advanced Calculus^ p. 194 and p. 364. 
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8) X = 


dF 
dx ’ 




dp 


Q 


dq 


Then 7) is equivalent to 

9) £^L£o ^ XZL21« . 

PQ 

We now have new geometrical data relating to the surface 3). 
It not only is tangent to the cone T in (^Tq, ^o)» assign 

a tangent line to 5 in this point, namely, that generator of T which 
is tangent to S, Thus to each point of S is assigned a directum, 
lying in the surface and having the direction components dx^ dz 
satisfying the relations : 


10 ) 


dx __ dy ___ dz 
P ~ pP + qQ 


More precisely, we think of a curve drawn through (:ro,yo»^o) 
surface 5 : 


11 ) x=/(X), y = <p{'K), z = '^{\). 


having in (a^o.^o- * 0 ) direction componaits giv«i by the equations: 


12 ) 


dx 

d\ 


P, 



dz 

dk 


= pP+gQ. 


We see, then,, that the surface S is swept out .by a one-parameter 
family of such curves. They are determined through the existence 
theorem of § 3 (including, in particular, the property of uniqueness) 
by the system of differ«atial equations: 


£.Z. = 2- _ pP + qQ 

dx P ' dx P 


in case P ^ 0; otherwise by 

dy Q" dy Q ’ 

where p^ q are givaa by 3). 

Let us follow one of these curves along the surface S, The curve 
can be represented by Equations 11), thought of as an integral of 
12), p and q being obtained from 3). Now, turn to Equation 1). 
This becomes an identity in x and y when we substitute for z, p^ q 
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their values from 3) and 2). Hence the partial derivatives with 
respect to x and y vanisii identically, or 
' * 


15) 


X + ,Z + P-||-+Q-|^ = 0 

>' + »=^ + '’ -If- + 

On the other hand, along the curve 11), we have from 12): 

r 


14) 


AE. = lE.Al- + lE.ly. = plL.ArO-^ 

dk dx dk ^ dy dk dx ^ dx 


dk 
Hence 


dx dX dy dX 


dy 


dy 


15) X-pZ, ^=-Y~qZ. 

We may write the final result in the form: 

^ dp ^ dq 
jP X. "{■ p '/a Y q 

These equations, irrespective of any particular integral surface 
3), and also irrespective of the condition of inequality, foot-note, 
p. 388, define a four-parameter family of curves in the five-dirnensional 
space of the variables {x,y,z,p,q). Since P and Q are not both 0 
in the point A: let 0 there. The primitive of 

16) can then be written in the form : 

( X=fi (*! *0. Jo. *0. Po. 7 o) 

^ ^ j * = /2 (^: ^0. Jo. *0. Po< 9 o) 

I P = fa (x; xq, Jo. 2 o. Po^ Vo) 

V 9 ~ ft -^0. Jo. ^0. P')i Vo) 


Each function admits a continuous first partial derivative with 
respect to each of the six arguments, x ; jtq* * ' * i § ^^^e partial 

derivative dfi/dx is the same as the total derivative dy/dx in 
16), or 



DIFFERENTIAL EQUATIONS. EXISTENCE TfiEOREMS 591 


and similarly for each of the other dfj^/dx. Moreover, the order of 
differentiation between x and any one of the arguments xo, 

^0 always be reversed, § 5: 


19) 


d dr _ d'^y 
dx dx dfQ ’ 


The Curves C, The four-parameter family of curves 17) shall ^ 
be denoted as the Curves C. They sweep out the neighborhood of 
the point A just once. Without loss of generality we can set xq = 
and then <7o represent the four independent parameters of 

the family, the equations now taking the forni : 

^ y =/i ix ; a, Jo. 2o. /’o. 9o) 

^ =/ 2 (.J^; a. ro. Zo. A'o. 9o) 

\ ^ / s 

P=j3ixi a, Jo. zo, />o. %) 

1. 9=/4(z;a. Jo, zo,/>o. 7o) 


Along any one of the curves C the function F is constant : 

21) F {x, y, z, p, q) = C, 
as appccrs at once fro.n 16) : 

22) =X + 1*42^+ Z-^ + P-^+ Q-^ = 0. 

dx dx dx dx dx 


Thus we have in 21) an integral of the simultaneous system of total 
differential equations 16), 

From the foregoing analysis and the theorem of uniqueness we 
axii infer the following theorem, 

TiiroRi.M 1, Let (ro, Xq^ Zq, po, <7o) ^ ^ point of the neighbor- 
hood of A, such that 

Let 

23) X = ♦ (x, y) 

he an integral of the partial differential equation 1), where ^ (x, y) 
is continuouSy together with its first derivativeSy in the neighborhxxid 
of (x, y) = (xq, /o)» wherCy furthermorey 


♦ Uo» yo) = «o» (^0. yo) = A* (^0. yo) — 7 o- 
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Then the curve defined by the first two equations 17) lies wholly 
in the surface represented by 23), and at each point of this curve 

y) = P, r) = 7 

where q are given by the last two equations 17). 

Parametric Form, The curves C can he represented in par- 
ametric form as follows. Replace 16) by the extended system: 

oa.\ — --dp _ dq du 

^ p ^ pp qQ'^ X -hpz y-^qz 1 ^’ 

where (r = G (j:, y, z, p, q^ it) is continuous, together with its second 
derivatives, in the neighborhood of the point {a, b, c, a, fi, 0 ) and 
does not vanish there. If, in particular, G = 1 , then u is usually 
represented by t: 



Or, again, we may set G P^ when P ^ 0, and then a = x. and 
we fall back on the integral in the form 17) or 20). 

In the general case we have as the integral of 24): 


25) 


' X = (w; Xo, yo, Zo, Po, qo) 

y = q>2i^'^ Xo, Poy ^o) 

^ Z=n (w; rOt POy 9o) 

p = q>^{u; Xo, Jo» P(» 9o) 

< q- 9 h («; Jo. P^y ^o) 


These equations, for values of u near 0, represent the curves C. 

Characteristics. The curves C form the basis for the definition 
of the characteristics of the partial differential equation 1 ). Some- 
times these curves themselves are called characteristics. More narrowly, 
it is the curves C for which 


26) F (xo, jo» 2 : 0 , Poy 7 o) = 0 

that have especial importance for the integration of 1 ). The first two 
of equations 17) or the first three of equations 25) define a curve in 
the (a:, y, z)-space and assign to each point of this curve a tangent 
plane, the direction coi^ponents of whose normal, {p^ 7 , — 1 ), are given 
by the last two equations. Such a curve and the tangent planes as- 



DIFFERENTIAL EQUATIONS. EXTSIENCE THEOREMS 393 


sociated with its points are called a characteristic strip, A characteristic 
strip is said to lie in a surface if the curve lies in the surface and 
each associated plane is tangent to the surface. 

In the foregoing developments is contained the proof of the 
following theorem. 

Throrkm 2. Ij S is the surface corresponding to a solution 
of 1) and if the curve of a characteristic strip meets S in a point 
O, the associated plane at O being tangent to 5, then the whole 
characteristic strip lies in S, 

It is wjderstood that S is a regular surface such as is given 
by 23). 

There is a three-parameter family of characteristic strios, and 
it can be represented by 20), subject to the condition 

27) F {a, Jo, ^0- Pa> 9o) = 0- 

The curves of these strips, represented by the first two equations 20), 
combined with 27), course the neighborhood of the point (:r, y^ z) 
= {a, b, c) and carry with them their tangent planes. The proble n 
of integrating 1) is to fit into this neighborhood, in all possible 
ways, surfaces which coincide at each point with a characteristic 
strip. We turn now to the solution of this problem. 

§14. Continuation. Integration by Means of Charac- 
teristics. Let a curve 

28) 2o = <“ (Xo) 

be drawn in the plane x = a. Here, « ( j) shall be continuous, 
together with its first and second derivatives, in the neighborhood of 
the point y = b, and moreover oj (b) shall = c : 

c = « {b). 

Restrict y^ to the neighborhood of b. 

Through each point of this curve passes a curve C, defined as 
follows, yo and Zq shall be connected by 28). Furthermore, gQ shall 
have the value : 

= «' (ro)- 
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Finally, shall be given by 27). Thus appeal's as a parameter ; 
set it equal to r: 

ro - V- 

These curves C sweep out a surface, defined parametrically by 
the first three equations 25), where we shall find it convenient to 
take the parameter ii as or, and to set = a. Thus ip^ ^ u and 
equations 25) reduce essentially to 20), but the exposition is clearer 
in the parametric form : 


29) *r=/(u, v), y — <p{u,v), z — y^{u,v). 

First of all. 


For, since x = w, 


j_ B (x, y) 
B (w, v) 


^ 0 . 


Next, 

and hence 




<P 2 {a; a, Xq, Zq, Po, q^) = Jq = v, 


- 5 ^ = 1 when u = a. 

ov 


Thus 7=1 when u ^ a, v ^ b. It is, therefore, possible to solve 
the first two equations 29) for u and v. Substituting these values in 
the third equation, we find : 

50) z = $ (x, y)y 

where ^{x^y), together with its first derivatives, is continuous in the 
neighborhood of ia, b). 


Thi ori.m 1. The function $ (x, j ) is a solution of the given 
partial differential equation: 


31 ; 




dx ’ dy 

'J he direction components of the normal to the surface 30) are 
^r, "“!)• ^Ve b^tve to show that make the equation 

F{x,y,z, = 0 



DIFFERENTIAL EQUATIONS. EXISTENCE THEOREMS 595 


an identity in [x^y). Now, from 30), 

dz = ia: 4- dy, 

no matter what the independent variables are, And conversely, if 


32) dz ^ p dx q dy, 

no matter what tlie independent variables may be, it follows that 


A necessary and sufficient condition for the truth of 52) is : 


33) 


dz __ dx 
du ^ du 


+ 


q 


dy 
du ’ 


dz I ^ 

dv dv dv 


The first equation is equivalent to 


dz 

dx 


^ q 



and is true because of 16). 

To establish the second equation, write 


34) U{u,v)r= 

Along the curve 28) 

d z d Zn f f \ 

= -3-^ = <» (jo). 

dv dya 

and hence 

35) 


dz _ dx _ dy 
'd7 ^ dv 


dx _ _ Q dy _ 

dv dyQ ’ dv 

U(a, v) = 0. 


^7n = 1 
dyo ' 


'Ve will show that U (u, v) = 0 along each curve C. 

To do this, compute dU/du along an arbitrary C. Remember- 
ing that, on account of 19), the order of differentiation can be 
reversed, we have : 


du_ d dz 
du dv dx 


dp dj^ 
dx dv 


-p.Q-i3.1y-a±. ^ 

dx dv dv dx 


^±^pP + ffQ X + pZ dx Y+gZ dy d Q 

dv P P dv P dv dv P 
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= ^{(:f + ;,z)-|£. + (r+,z)4r^p|i 


+ Q 


^9 I 

dv 1 


On the othei hand 


37) 


F(x, X, z, p,q) — 0 


along any curve C and h«ice at ever>' point of the surface 30); i.e. 
37) is an identity in the variables (u, v). Hence 

o = A:|i+ rj2: + z|^ + p|^ 

OV OV €V OV OV 

On subtracting this equation* divided by P, from 36) and re- 
membeiing 34) wre find: 


38) 


du P 


It is this equation which determines U along a curve C. Re- 
garding* then* V as a parameter which characterizes C, we may write 
38) in the form : 


39) 


dx P 


We seek the solution of this differential equation which vanishes when 
X = One such solution is t7 = 0, Because of the uniqueness 
theorem there is only one solution* and the proof is complete. 

Tiikohrm 2. Let 

40) jr = (x* y) 

he a solution of 1 ), where (x, y) is continuous^ together with its 
derivatives of the first order ^ in the neighborhood of the point 
(tf , b) and ^ {a, b) = c. Let F be the curve in which the surface^ 
5, represented by 40) is cut by the plane x = a ; 

41) x = a, z=Sk(x*jy). 

Then the characteristic strips determined as above by F sweep out 
S just once. 

For, first, a characteristic strip determined by a point of F and 
the tangent of F at that point, lies wholly in 5 ; § 13, Theorem 2 
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Secondly, at an arbitrai 7 point of 5 a characteristic strip is determined, 
which lies wholly in S. The curve of this strip cuts the plane 
jr: = and the point of intersection is necessarily a point of F. 

This theorem is only partially a converse of Theorem 1. For 
in that theorem, the function co (jr) was required to possess a second 
derivative. But it can happen that the curve of Theorem 2 is such 
that (tf , y) has no second derivative ; e g. 

p{x,y,z,p,q) =p. 

On the other hand, Theorem 1 is not true if oj {y) is required 
merely to possess a continuous first derivative, as is shown by the 
example : 

F(x,y,z,p,q) -p + q-, 

U 

o{u) = f{u) du, 

<> 

/(w) = w* sin ^ 0; /(O) = 0. 

u 

Here, [a^ b, c) = (0, 0, 0). 

The form which Theorem 1 should take, if it and Theorem 2 
are to be each the converse of the other, is the following: — 

Theorem 1^: Given the partial differential equation 1). Let 
(jy) be continuous y together with its first derivative, in the neigh- 
borhood of the point r ^ b, and let o {b) = c. Let F he the curve : 

X = a, z = CO {y). 

Consider the characteristic strips determined by the points and 
tangents of Y, If the curves of these characteristic strips sweep 
out a surface 

z = ^ (x, y\ 

where ^{x,y) is single-valued and continuous, together with its 
derivatives of the first order, in the neighborhood of the point {a, h), 
then ^ (jT, y) wUl be a solution of 1). 

^ sufficient, but not a necessary, condition for the fulfillment 
of the last hypothesis is, that coi (y) possess a continous second de- 
rivative. 
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Uniqueness. Observ'e that in an}' rase two solutions of 1), wliirh 
rx)rrespond to one and the same curve F, are identical. 

More generally, let 5 and S' be the surfaces corresix)nding to two 
solutions of 1). and let S and S' be tangent to each other along a 
curve r' which nowhere touches a characteristic cune of either s\trface 
Then the solutions are identical. 


§15, The Case of n Variables. Both the theoie.n and the 
treatment by characteristics can be extended immediately to the general 
case. Let the partial differential equation 

f(xi, ■ ■■ .■^) = 0 


1 ) 


be given, where Fixi, *•*, *• *,;?„) is continuous, together 

with its partial derivatives of the first two orders, in the neighborhood 
of the point • • • , c, Z>i, * • *. ^/j). Write 




3F 


Z = 


aF 


Pk^ 


dF 

dpk ' 


dxf, * dz 

I^t the Pk not all vanish in the point 

The characteristics are defined on the hand of the 2n equations: 

dz 


2 ) 


dxk __ dz __ — dp^ 

Pk ^PkPk Xk Pk’^' 


h = L 


*, w. 


These equations determine a 2/z-parameter family of curves C in the 
{2n -p 1 )' dimensional space of the variables, which, in case P^^ 0 
in A, can be represented in the form: 


3) 


fkW-A^ 


Pk=fn^-}W, x\, • 
Here, xj can be held fast : 

4) 


. ^0 „o , 

, Ply 

. , ^0 yO „0 

yXn^ Z , Ply 

> • 

» ^ ♦ ri» 




■>pll 

'^pl)> 


A = 2, • • •, rt; 


7 = 1, • • n. 


and then • • •, xj, z", pf, • • •, afford a s)'stein of 2n independent 
parameters. 

The characteristic curves are defined by the first n of the equa- 
tions 3), where the are subject to the conditions 4) and 

5) F(x5, = 
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The characteristic strips are defin^ by all 2n of the equations 
5) and are thought of as the characteristic curves, to each point of 
which is assigned a (hyper-) tangent plane, the direction-components 
of the normal being % pS)* 

FiOm here on the theory proceeds as in the earlier case, cul- 
minating in the 

Theorem. Given the partial differential equation 1) with 
Pi ^ 0 in A, Let q (zo, * • • * X;,) be continuous, together with its 
partial derivatives of the first order, in the neighborhood of the 
point (floi * * • » tf/i) and let 

(tfo* * * *1 tin) = c. 

Through each point of the manifold 

x = ai, z® = «(x2. •• -.x") 

pass the characteristic strip determined by the point and the tangent 
plane; i,e, set 

d <0 

p^ being given by 5). 

If the corresponding set of characteristic curves, determined 
by the first n equations 5), sweep out a surface, 

z = 9{xi, 

where ^{x^, •••,Xn) is single-valued and, together with its partial 
derivatives of the first order, continuous in the neighborhood of 
{di, • • ',an), then $ {xi, • • *,Xn) is a solution of 1). 

A sufficient, but not a necessary, condition for the fulfillment 
of this last hypothesis is, that © (xj, • • • , x„) admit continuous 
derivatives of the second order. 

Conversely, any solution of \) satisfying the conditions im- 
posed on i{xi,**-,Xn) defines a surface which is swept out by 
characteristic curves as above. 

Uniqueness, The earlier theorem of uniqueness for the case 
/i = 2 admits of direct generalization to the case n = n. 
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